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Broadening concepts of education increasingly stress the function 
of the school in individual guidance and adjustment. This in turn 
has quickened the demand for devices to aid in identifying pupils in 
need of special attention, and analyzing the difficulties which confront 
them. Many tests, inventories, rating scales, and record systems are 
now available for this purpose. The better of these are the fruit of 
extensive experimentation and validation by their respective authors. 
Only rarely, however, have the finished instruments been submitted 
to objective investigation to determine their comparative merits for 
particular uses. 

The present study undertakes to compare the serviceability of 
four inventories of the questionnaire type in predicting problem 
behavior at ninth- and tenth-grade levels. The behavior in question 
may be defined as “disciplinary conduct resulting from social ,and 
emotional maladjustment.” Important contributory factors would 
probably be found in intellectual deficiencies, poor home environment, 
ill health, and emotional instability. With the exception of intelli- 
gence, the relation of which to misbehavior has already been studied 
extensively, each of the factors named is measured by one or more of 
the testing instruments considered. 











TESTS OR INVENTORIES COMPARED 


The four inventories selected for study are commercially available 
‘ and favorably known. Since the facts as to their derivation and 
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standardization have been adequately set forth by their authors in the 
test manuals or supplementary articles, brief descriptions may here 
suffice: 

1. The Sims Score Card for Socio-Economic Status‘ consists of a 
folder of twenty-three questions covering such matters as the number 
of rooms and conveniences in the home, parents’ education and occupa- 
tion, family cultural interests, recreations, etc. Pupils’ answers yield 
scores which are reported to show no overlapping between children 
of professional parents and those of unskilled laborers.2, Obviously 
such scores are not a direct measure of behavior or adjustment. 
Delinquency is, however, frequently attributed to the living conditions 
of children in “underprivileged homes.’”’ Moreover, a questionnaire 
similar to this was one of the only two devices found by Lentz* to 
discriminate repeatedly between delinquent boys and an unselected 
public-school group. 

2. The Bell Adjustment Inventory‘ is composed of one hundred ten 
questions to be answered “ Yes,” ‘‘No,” or ‘‘?.”” These yield separate 
scores for home, health, social, and emotional adjustments. ‘The 
following are typical of questions in the four fields: (Home) ‘Does 
either of your parents become angry easily?” (Health) ‘Have you 
frequently been absent from school because of illness?”’ (Social) ‘‘ Do 
you ever cross the street to avoid meeting somebody?” (Emotional) 
“‘Does it frighten you to be alone in the dark?”’ High scores indicate 
unsatisfactory adjustments. Individuals scoring high on social items, 
for example, are said by the manual to tend to be submissive and 
retiring; and those scoring high on emotional items to be unstable. 

3. The Personality Inventory by R. G. Bernreuter® includes one 
hundred twenty-five questions similar in form to those employed by 
Bell. By means of separate scoring keys assigning different weights to 
answers, the same paper can be made to yield four distinct scores, 





1Sims, V. M.: Sims Score Card for Socio-Economic Status, Form C. mee 
ington, Ill.: Public School Publishing Co., 1927. 

*Sims, V. M.: The Measurement of Socio-Economic Status. Public Sch ool 
Publishing Co., 1928, p. 29. 

* Lentz, T. F., Jr.: An Experimental Method for the Discovery and Development 
of Tests of Charester. New York: Teachers College, Columbia University, Cyn- 
tributions to Education, No. 180, 1925, ad loc. 

‘ Bell, H. M.: The Adjustment Inventory. Stanford University, Calif.: Stin- 
ford University Press, 1934. é 

5’ Bernreuter, R. G.: The Personality Inventory. Stanford University Press, 
1931. : 
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termed B1-N for neurotic tendency, B2-S for self-sufficiency, B3-I for 
introversion, and B4-D for dominance. High scores are said to indi- 
cate, respectively, neurotic tendency or emotional instability, a 
preference for being alone and avoiding sympathy or advice, introver- 


‘sion, and a tendency “to dominate others in face-to-face situations.” 


Since the scale for introversion is reported in the manual to correlate 
.94 with that for neuroticism, which has a higher reliability, the papers 
of the present study were not scored for introversion. 

4. The Personal Index by G. C. Loofbourow and Noel Keys! is 
designed, according to the manual, “‘for the detection of attitudes 
indicative of problem-behavior.”” As published in 1933, this had four 
parts: a ‘‘vocabulary”’ test containing thirty fictitious words concern- 
ing which the subject is to state whether he knows their meaning, a 
multiple-choice test in which he is to check the answer best expressing 
his attitude toward “‘bumming rides,’’ “speed-cops,” and fifteen other 
practices or persons, a “virtues” test of twenty-one questions, and an 
adjustment questionnaire of eighty-nine items similar to those of the 
Bell and Bernreuter inventories. Later, unpublished studies by A. E. 
Joyal and W. C. Riggs in Denver, and Keys in Pacific Coast cities 
indicated that the “virtues” test tended to lower the validity of total 
scores. This section was consequently omitted from the 1937 edition 
of the Index. In the present study, scores were computed separately 
according to both 1933 and 1937 forms. 

All four of the instruments named are reported by their authors 
to show reliabilities above .90, and reasonably satisfactory validity, 
according to various criteria. 


SUBJECTS OF THE EXPERIMENT 


The freshman and sophomore classes of the high school of Chico, 
California, constituted the subjects of the present experiment. This 
is a four-year school of near one thousand enrolment, located in‘ the 
upper Sacramento Valley, some one hundred ninety miles from San 
Francisco. The study was made possible only by the prolonged 
coéperation of Principal F. L. Cummings and his staff of counselors and 
homeroom teachers. With their assistance, the tests named were 
administered to the two classes in the school year 1934-1935. The sole 
exception was the Bernreuter Inventory, which had already been given 
to members of the sophomore class in their freshman year. The 





1 Loofbourow, G. C., and Keys, Noel: Personal Index. Minneapolis, Minn.: 
Educational Test Bureau, 1933. Revised edition, 1937. 
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Bernreuter scores of these pupils were, therefore, copied from the school 
records. 

Complete data on all four tests were secured for one hundred forty 
boys and one hundred thirty girls. An additional fifty-seven boys and 
seventy-eight girls, however, had records complete save for one test, 
missed by reason of absence or the like. It was decided to include 
these cases also, making a total of one hundred ninety-seven boys and 
two hundred eight girls, or four hundred five pupils in all. Owing to 
the fact that in a few homerooms satisfactory teacher ratings proved 
impossible to obtain, numbers in computations involving the Haggerty- 
Olson-Wickman scale were still further reduced. As shown in the 
ensuing tables, correlations were based on numbers ranging from one 
hundred thirty to three hundred seventy-five. As between one 
inventory and another, however, differences in the populations 
involved were small, and probably did not appreciably affect the 
results. : 


CRITERIA OF BEHAVIOR 


In evaluating pupils’ behavior, two distinct types of rating were 
employed. Of these, one involved highly detailed and itemized ratings 
by single judges; the other, a blanket rating determined by the com- 
posite judgment of a group. For the first, the Haggerty-Olson- 
Wickman Behavior Rating Schedule! was utilized. This device entails 
five pages of ratings for each individual, with subsequent computation 
of scores. Schedule A is concerned with the comparative frequency of 
fifteen types of overt misconduct, ranging from tardiness and cheating 
to stealing and sex offenses. Schedule B involves placing the pupil by 
check mark on graphic and well-defined scales for thirty-five traits 
such as alertness, courtesy, energy, excitability, and moodiness. 
Scores are the sum of weights experimentally determined for behavior 
of the type noted with respect to each of the fifty points considered. 

To determine whether ratings on overt misbehavior of the type 
covered by Schedule A would constitute a more satisfactory criterion 
than the totals for A and B combined, the writers computed ten correla- 
tions between Schedule A and scores on the inventories of this study. 
These correlations, however, averaged but .14 as compared with .18 for 
the corresponding correlations based on A and B totals. The total 
ratings were therefore adopted as the more indicative. 





1 Haggerty, M. E., Olson, W. V., and Wickman, E. K.: Behavior Rating Sched- 
ules. Yonkers on Hudson, N. Y.: World Book Co., 1930. 
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In Chico High School, entering freshmen are divided according 
to sex, then subdivided into groups of twenty to thirty pupils. Each 
such group is assigned to a particular homeroom teacher, who con- 
tinues in that relation to them until their graduation. In the present 
study, every homeroom teacher of a freshman or sophomore group was 
asked by the principal to fill out Haggerty-Olson-Wickman schedules 
for each boy or girl in his charge. Such ratings were, in fact, obtained 
from eighteen teachers, ten of boys’, and eight of girls’ groups. These 
ratings were made between June 1 and December 20, 1935, or on an 
average of six to nine months after the inventories and tests had been 
administered. The time element was, therefore, such that each rater 
had acted as homeroom teacher to the pupils rated for a minimum of 
one school year; while in half the cases, the period amounted to four 
semesters or more. 

At best, however, a rating by one individual is subject to many 
weaknesses. In the manual for the Haggerty-Olson-Wickman Sched- 
ules, the authors report a reliability of .92 for individual ratings as 
determined by split-halves and the Spearman-Brown formula, but as 
between the ratings of different teachers, a correlation of only “about 
.60.” This great discrepancy clearly reflects the importance of “‘halo”’ 
effect and bias in individual judges. When, in addition, ratings 
obtained on certain pupils from one teacher are thrown into the same 
distribution with ratings made on other pupils by different teachers, 
the tendency of some teachers to rate generally high and others 
generally low operates to minimize the significance of the final rank 
order. The reliability of the resulting melange is, therefore, still 
further reduced. Since this was the situation in the present study, it 
was to be expected that the reliability of the H-O-W ratings would be 
under, rather than over .50. Yet the usual expedient of obtaining 
several ratings on each individual and averaging was here impractical, 
since each had had but one homeroom teacher in high school. 

Fortunately, the principal, counselors, and deans have sufficient 
contacts with pupils to acquaint them with outstanding merits and 
shortcomings. In order to tap the combined knowledge of these 
administrators, a second, or blanket-rating, scheme was devised for 
use by the conference method. During the week following the close 
of school in June, 1935, the principal, two counselors, one dean of boys 
and two deans of girls met and assigned to each freshman or sophomore 
pupil a “star rating” on behavior. In arriving at this, they worked 
with class rolls before them and according to the following directions: 
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1. Select, to the extent of fifteen to twenty per cent of the total 
enrolment, those pupils you agree constitute, in school or out, behavior 
problems of the type defined above. Star their names in red. 

2. Select those whom you regard as uncommonly well adjusted and 
fine persons, likewise to the extent of fifteen to twenty per cent of the 
enrolment. Star their names in blue. 

3. Out of group 1, select those whose behavior is most serious, such 
as a juvenile court record or conduct justifying such, near nervous 
breakdowns, and the like. Limit this selection to about five per cent 
of the total enrolment. Before their names place a second red star. 

4. Out of group 2, select those whom you regard as the outstand- 
ingly finest boys or girls in school, those of best conduct, “just what 
you would wish a son or daughter of yours to be,” etc. Before their 
names place a second blue star. Mark about five per cent of the total 
enrolment thus. 

5. Then go over the sixty or seventy per cent left unstarred and 
agree on those you can say are above average in their adjustment and 
conduct, even though not strikingly superior. Mark these with a blue 
plus sign. Similarly, those whose behavior is below average, even 
though not serious problems, mark with a red minus sign. 

6. The remaining twenty to forty per cent leave unmarked, as 
average. 

7. Convert the symbols into numerical values as follows: 


> 
a 








Behavior Mark wpeud Aypueninnte 

rating per cent 
Outstandingly finest................... two blue stars 1 about 5 
ein ek usieck.sccee se eed one blue star 2 10 to 15 
Better than average................... blue plus sign 3 15 to 20 
NE asc d a wa ok a9 5480.8 > 0 00.00 0h unmarked 4 20 to 40 
Poorer than average................ ...| red minus sign 5 15 to 20 
Problem behavior case................. one red star 6 10 to 15 
Problems of gravest character.......... two red stars 7 about 5 














METHODS OF DETERMINING CORRELATION 


The best measure of linear agreement between two ordered series 
is the Pearson product-moment coefficient, r. Such coefficients were 
computed between scores on each of the tests or inventories and both 
Haggerty-Olson-Wickman and star ratings. Product-moment correla- 
tion, however, does not work to optimum advantage with a scale of 
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but seven intervals, such as the star ratings, or in cases in which the 
true relationship is curvilinear. Moreover, if the object is to deter- 
mine the ability to discriminate problem-behavior cases from others, 
bi-serial correlation might be more appropriate. This is a method of 
measuring agreement between two traits, one of which is an attribute 
with only two categories, e.g., problem and non-problem, and the other 
a variable with numerous gradations, such as the test or inventory 
scores. As a check, therefore, on the Pearson coefficients and to 
facilitate comparisons with studies based on dichotomous classifications 
of delinquent versus non-delinquent, bi-serial correlations were also 
computed. 

For this purpose, pupils with star ratings of five to seven were 
defined as problem cases, and those rated one to four as non-problems. 
In order to give more weight to those whose problem status was most 
clearly recognized, individuals rated six were tallied twice and those 
rated seven tallied as though they were three persons. Similarly, 
among the normally behaved, pupils rated four, three, two, and one 
were weighted one, two, three, and four times, respectively. To 
obtain comparable coefficients for the H-O-W ratings, pupils lying 
between —.5 and +.5¢ were tallied once, those between —.5 and 
— 1.50, twice, those between —1.5 and —2.5c, three times, and those 
below —2.5c, four times. Likewise, pupils rating between +1.5 and 
+2.5¢ were counted as two, and those above 2.5¢, as three problem 
cases. Following this weighted tallying, bi-serial r’s were computed 
by the usual formula,’ 





_ Mp — My pa 


T 
7 Crotal Y4 


in which p = the fraction of the total number rated behavior problem 
cases ; 
q = the fraction of the total rated non-problem, or control 
cases 
z = the height of the ordinate at the point of division, as 
read from the Kelley-Wood table of the normal-prob- 
ability integral. 
In interpreting the coefficients of Tables I to V, it is important 
to remember that high numerical ratings by either H-O-W or star- 
rating scales indicate problem behavior. Positive correlations, there- 





1 Kelley, T. L.: Statistical Method. New York: Macmillan, 1923, p. 248. 
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fore, signify that the attribute measured by the test or inventory 
tends to go with undesirable rather than desirable conduct. Since in 
most cases, these attributes are themselves forms of maladjustment, 
positive correlations would be anticipated. Tne Sims Score Card, 
however, constitutes a notable exception. High scores on it mark 
superior socio-economic status, which might be expected to correlate 
negatively with misbehavior. Positive correlations, such as occur in 
the case of the girls, would imply that problem-behavior is more 


frequent in children from homes of good rather than poor economic 
circumstances. 


bl 


CORRELATION BETWEEN INVENTORIES AND RATINGS 


Tables I and II present, respectively, the product-moment and 
bi-serial correlations between the several inventories and the Haggerty- 
Olson-Wickman ratings by homeroom teachers. Tables III and IV 
show the corresponding correlations with star ratings assigned by 
the group of administrators and counselors. 


TaBLe [.—Propuct Moment CoRRELATIONS BETWEEN INVENTORY SCORES AND 
HaGGeErty-O.tson-WICKMAN Bexavior Ratincs sy Homeroom TEACHERS 

















Boys Girls Total 
Inventory 
N r N r N r 
4 

Sims Score Card for Socio- 

Economic Status....... 132} —.09 +.05/132 .08 + .06\264 -000 + .04 
Bell Adjustment Inventory 

Rs cae o.b's eb ewd 134 .03 + .06)149 .24 +.05/283 15 +.04 

CMEC sk pucbsecectan 134 .001 + .06)149 .12 +.06|283 .06 +.04 

GS oss Nie weete 134; —.15 +.06/149) —.06 +.06/283) —.10 +.04 

d. Emotional........... 134; —.03 +.06)149 .05 + .06/283 .03 +.04 

ETT Pere 134; —.08 + .06)149 .03 + .06|283 04 +.04 
Bernreuter Personality In- 

tory 

N. Neurotic tendency. .|/130 .O1 +.06)131); —.05 +.06/261; —.04 +.04 

S. Self-sufficiency...... 130 .04 +.06/131 .003 + .06/261 .07 +.04 

D. Dominance......... 130 .08 + .06)131 .17 +.06/261 15 +.04 
Loofbourow-Keys Personal 

Index 

Questionnaire only...... 133 .28 +.06\151 .22 + .06|\284 .28 +.04 

Total by 1933 edition. . .|133 .238 +.06)151 .25 + .05|284 24 +.04 

Total by 1937 edition. . .|133 .28 +.06)151 .26 + .06'284 .27 +.04 
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Taste II.—Mopiriep Bi-seriaL CoRRELATIONS BETWEEN INVENTORY ScorREs 
AND HacGaerty-O.Lson-WIcKMAN Bexsavior Ratines sy Homeroom THACHERS 














Boys Girls Total 
Inventory 
N T bis N Tbis N Tbis 
Sims Score Card for Socio- 
Economic Status....... 132) —.12+.06)132; .21+.07/264, .04 +.05 
Bell Adjustment Inventory 
hs Sh se aticeeedh ces 134, .03+.07|149| .28+.06)\283 17 +.04 
Dir cidindscuoavewiba 134, —.02+.07|149| .11+.06)\283 .04 +.05 
EIN i eisices fice. oe 134; —.24+ .07|149| —.03+ .06/283) —.04 +.05 
d. Emotional............. 134, — .06+ .07/149 .05 + .06/283) —.003 + .05 
PI ii da wat ineesiicn 134) —.14+.07|149) .13+.06/283) .01 +.05 
Bernreuter Personality In- 
ventory 
N. Neurotic tendency..... 130} — .09+ .07|131) —.06+.07\261) —.12 +.05 
S. Self-sufficiency........ 130} —.08+ .07/131 .21 + .07/261 .08 +.05 
D. Dominance........... 130} .22+.06)131 .82+ .06\261 27 +.04 
Loofbourow-Keys Personal 
Index 
Questionnaire only........ 133 .40 + .06\151 .80 + .06'284 84 +.04 
Total by 1933 edition... .. 133 .86 + .06|151 .85+ .06\284, .86 +.04 
Total by 1937 edition..... 133 .87 + .06|151 84+ .06\2845 .85 +.04 




















In general, ratings obtained from the Haggerty-Olson-Wickman 
schedules (Tables I and II) correlate less well with the inventories than 
ratings by means of the star scale (Tables III andIV). The average of 
the twenty-four r’s for the total group, disregarding signs, is only .13 for 
the H-O-W, as against .21 for the star ratings. This is doubtless an 
indication of higher reliability and validity for the star ratings. No 
conclusion can be drawn, however, as to relative merits of the two 
devices, or of blanket versus itemized ratings in general, since the star 
ratings represent the composite judgment of a group. 

Comparison of Tables I and III with II and IV, respectively, 
reveals that the modified bi-serial technique yields somewhat higher 
coefficients than does the product-moment method with these data. 
For H-O-W ratings, the arithmetic average of the r’s for the total group 
is .15 by the bi-serial as compared with .12 by the product-moment 
method, an increase of .03. As applied to the star-ratings, however, the 
corresponding averages are .16 and .27, a difference of .11. The 
much greater increase observable in the case of star-ratings suggests 
that product-moment correlation does not fully reflect the degree of 
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association when data are based on a scale of but seven intervals. A 
slight curvilinearity in the relation of star ratings to certain inventories 
was likewise overcome by this means. 

The most striking features of all four tables is the generally low 
value of the r’s obtained. A correlation amounting to four times its 
probable error would not occur one time in one hundred by chances of 
sampling alone, and so may be regarded as statistically significant. 
Coefficients which meet this requirement are shown in italics. All 


TaBLe III.—PRopvucT-MOMENT CORRELATIONS BETWEEN INVENTORY SCORES AND 
Star Ratines BY Composite JUDGMENT OF ADMINISTRATORS AND COUNSELORS 




















Boys Girls Total 
Inventory 
N r N r N r 
Sims Score Card for Socio- 
Economic Status........ 179| —.23+.06172) —.11+.05)351| —.18+.03 
Bell Adjustment Inventory 
Ns «as ica > nde W's VaR 181 .11+ .05)192 . 26 + .06|\373 15+ .083 
IS 5 6.8 sic elite wean pcan e 181 .11+ .05)192 .14+ .05/373 .13+ .08 
eile miinmas bubice dee 181 .15 + .05)192 .03 + .05|373 .08 + .03 
a ey 181 .16 + .05)192 .11 + .05|373 .11+.03 
PIB So vce cecccccses 181 .18 + .05)192 .18 + .05|373) .17+ .08 
Bernreuter Personality In- 
ventory 
N. Neurotic tendency...... 169 .11+.05)161 .12 + .05|330 10+ .04 
S. ‘Self-sufficiency......... 169} —.07+.05|161} .13+.05|330} .02+.04 
D. Dominance............ 169} —.05+ .05)161 .01 + .05 — .02+ .04 
Loofbourow-Keys Personal In- 
dex 
Questionnaire only......... 17 . 28 + .05|196 .20 + .06|375 24+ .08 
Total by 1933 edition...... 179 .28 + .06|196 .89 + .04\375 .83 + .08 
Total by 1937 edition...... 179 .81 + .05|196 .41 + .04)3875 .85 + .08 




















correlations involving the Personal Index are positive and significant, 
though lower than might have been anticipated. Of the one hundred 
eight other coefficients, however, but twenty-one are large enough to 
afford this practical certainty that the true relationship is in the direc- 
tion indicated by the sign. 


THE UNRELIABILITY OF BEHAVIOR RATINGS 


A plausible explanation of the low correlations discovered would be 
lack of reliability or validity in the criteria of behavior. The best 
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measure of the reliability of ratings such as here employed is the cor- 
relation between ratings assigned by different judges or groups of 
judges. The present study afforded no means of determining this for 
H-O-W and star ratings separately. It was, however, possible to 
correlate the two sets of ratings with one another. This procedure 
showed for the boys an r of .26 + .05, for the girls, .55 + .03, and for 
the total population, .38 + .03. 


Taste IV.—Mobpiriep Bi-seriaL CORRELATIONS BETWEEN INVENTORY ScoRES 
AND Stak RaTinGs BY COMPOSITE JUDGMENT OF ADMINISTRATORS AND COUNSELORS 























Boys Girls Total 
Inventory 
N Tis N Tia N This 
Sims Score Card for Socio- 
Economic Status........ 179) — .23 + .07|172 .08 + .07|351| —.18+.04 
Bell Adjustment Inventory 
SR. cccg cosas caecta 181 . 24+ .06\192 .40 + .06\373 .82+ .04 
Cs ceccccccd saves am 181 .29 + .06)192 .27 + .06\373 -28+ .04 
ere ere 181 -05 + .06)192) —.12+ .06|/373) —.05+ .04 
d. Emotional.............. 181 .29+ .07|\192; .10+.06/373) .14+.04 
po ES 181 .80 + .06|192 .20 + .06|373 .21+ .04 
Bernreuter Personality In- 
ventory 
N. Neurotic tendency...... 169} .01+ .06/161 .02 + .07/330 .01 + .05 
S. Self-sufficiency......... 169, .12+.06)161 23+ 739 17+ .05 
D. Dominance............ 16 .14+ .06/161 .13+ .07 17+ .05 
Loofbourow-Keys Personal In- 
dex 
Questionnaire only......... 179} .61+.05)196| .74+.04/375 .60+ .08 
Total by 1933 edition...... 179 .61 + .06|196 .61 + .06\375 65 + .04 
Total by 1937 edition...... 179} .69+.06)196| .64+.06/375 .60+ .08 




















The variables in the situation are too numerous to warrant explana- 
tions as to why homeroom teachers agreed so much better with the 
administrative group in their ratings of girls than of boys. That 
they did so, is unmistakable. It must be remembered, however, that 
the same teachers did not judge both sexes; and that, whereas teachers 
of girls’ homerooms were all women, not all of the boys’ groups were 
rated by men. 

More important is the fact that the three coefficients average but 
40. While the reliability of the star ratings was probably higher 
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than this and that of the H-O-W ratings somewhat lower, the average 
reliability was apparently of the order of .4. 


CONCLUSIONS: DEGREE OF PREDICTION OBTAINABLE 


This information throws fresh light on the correlations of Tables I 
toIV. If, for example, the star ratings be accepted as the best criterion 
of problem behavior here available, it is evident that the Haggerty- 
Olson-Wickman ratings agreed with these to the extent of only .38 for 
the total group. The Personal Index in its 1937 form, however, shows 
a product-moment correlation with star ratings of .35, and a bi-serial 
r of .60. This test, therefore, serves to predict behavior as judged by a 
group of administrators and counselors as well as do painstaking ratings 
by instructors who have been for from two to five semesters the home- 
room teachers of the pupils concerned. 

In Table V the preceding data are presented in summary form. 
The twelve coefficients entering into each average in the next to the last 
column have been weighted inversely as the square of their probable 
errors... Among other advantages, this serves to give greater weight to 
those correlations based on a larger number of cases. In the final 
column, the mean coefficients are shown corrected for attenuation on 
the assumption of an average reliability of .40 for the ratings, and 
reliabilities of the inventories or parts thereof equal to those reported 
in the respective authors’ manuals. These corrected coefficients are 
presented for the reader’s convenience, and should be viewed as 
approximations only. 

Inspection of this and preceding tables leads to the following 
conclusions: 

1. For no test or inventory are the correlations shown sufficient for 
accurate prediction of the behavior of individual pupils. Scores, 
even on the Personal Index, must be regarded as suggestive only. 

2. Correlations based on the Personal Index are all significant, and 
conspicuously higher than those for other inventories. For the 1937 
form, these average .41 before, and .67 after correction for attenuation. 
While much lower than those obtained by the authors on original 
standardization, and disappointing in an instrument specifically 
designed to identify disciplinary problem cases, these might still 
be held to indicate ‘‘a degree of prediction comparable to that with 





1 Kelley, T. L.: op. cit., pp. 324-325, ‘‘The Best Weighted Average of Inde- 
pendent Variables.” 
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which a good intelligence test forecasts achievement in school 
subjects.”” 


TasLs V.—RaNGE AND MEAN OF TWELVE COEFFICIENTS OF CORRELATION FOR 
Eacu INVENTORY 











Number of cumaie 
correlations , 
Inventory lstatistically Range of r’s iss gue 
significant rected ati! 
Sims Score Card for Socio- 
Economic Status....... 3 — .23 to +.21) —.09+.02 —.15 
Bell Adjustment Inventory 
a is tele ad daria 8 + .03 to +.40 .20+ .02 34 
 . caccchustdeee 4 — .02 to +.29 18+ .02 .23 
EG 6 chs oe echeaca ae 0 —.24to +.15) —.02+.02 — .03 
d. Emotional............ 1 — .06 to +.29 .08 + .02 .14 
kc x's kn 095 3 —.14to +.30 12+ .02 .20 
Bernreuter Personality In- 
ventory 
N. Neurotic tendency.... 0 —.12to +.12 .01+.01 .02 
S. Self-sufficiency........ 0 — .08 to +.23 .07 + .02 .12 
D. Dominance........... 2 — .05 to +.32 12+ .02 .20 
Loofbourow-Keys Personal 
Index 
Questionnaire only........ 12 +.20 to +.74 .88 + .08 .62 
Total by 1933 edition..... 12 +.23 to +.61 .87 + .02 .61 
Total by 1937 editicn..... 12 + .26 to +.64 .41+ .02 .67 

















Lewin,” for example, in a somewhat similar situation, has recently 
reported an average correlation of but .40 between MA on the Terman 
Group Test and grades in five first-year subjects of three San Francisco 
high schools. Maller,* also, found for five thousand seven hundred 
sixty-three seniors in five large high schools an average correlation of 
only .36 + .01 between high-school grades and Terman Group IQ. 


1Loofbourow, G. C., and Keys, Noel: ‘‘A Group Test of Problem-Behavior 
Tendencies in Junior-High-School Boys.’’ Journal of Educational Psychology, 
Vol. XXIV, pp. 641-653, December, 1933, p. 651. 

* Lewin, Lillie: The Prediction of Success in Certain Academic Subjects in First 
Year Senior High School. Unpublished Ph. D. dissertation, University of Cali- 
fornia, Berkeley, Calif., 1937, p. 70. 

* Maller, J. B.: “‘Age versus Intelligence as Basis for Prediction of Success in 


High School.”” Teachers College Record, Vol. XX XIII, February, 1932, pp. 402- 
415. 
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3. The 1937 form of the Index shows higher validity than the 1933. 
Though differences observed are too small for certainty, omission 
of the “‘virtues” test was apparently an improvement. 

4. The value of the Index seems to lie chiefly in the adjustment 
questionnaire, the other two sections adding only moderately to the 
prediction afforded. That this questionnaire should show to better 
advantage than those of the Bell and Bernreuter inventories is perhaps 
explainable by the many items dealing with adjustment in school 
situations. The closer agreement cannot be attributed to knowledge 
by teachers and administrators of Index scores, since these papers were 
marked at the University of California and no results reported until 
all ratings had been submitted. 

5. Of the nine other inventories or sections compared, six show mean 
correlations sufficient for statistical significance, though too small for 
practical importance. 

6. Of these, the highest prediction is afforded by the home adjust- 
ment section of the Bell Inventory, with an average correlation of .20 
before, and .34 after correction for attenuation. These coefficients 
exceed those for the Sims Score Card by a statistically significant 
margin. Evidently the ‘‘goodness” of a home from the standpoint of 
children’s behavior is more a matter of human relationships than of 
economic circumstances. 

7. Poor social-economic status as measured by the Sims Card is 
significantly associated with problem behavior in boys as rated by 
principal and counselors. This is not true, however, of girls or of 
ratings by homeroom teachers. 

8. Health adjustments (Bell) are found significantly related to 
problem behavior as rated by administrators and counselors, but not by 
homeroom teachers. 

9. Social and emotional adjustment as measured by the Bell 
Inventory show very slight relation to disciplinary conduct. 

10. Of the Bernreuter scales used, scores for neuroticism and self- 
sufficiency yield no significant correlation with problem behavior. 
A tendency is observable, however, for homeroom teachers to rate 
the more dominant individuals as problems. The mean correlation for 
this trait is significant, though negligible (.12 + .02). 


SUMMARY 


The present study compares the serviceability of twelve tests or 
subtests of the inventory type as bases for the prediction of disciplinary 
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problem behavior. Appraisals of such behavior, though obtained 
under favorable circumstances, proved exceedingly unreliable. Cor- 
relations between the ratings of homeroom teachers and the composite 
judgment of a group of administrators and counselors averaged but 
40. Of the four inventories compared, only the Loofbourow-Keys 
Personal Index, which was specifically designed for this purpose, 
afforded predictions sufficiently high to be of practical value for the 
counselor. Scores on the 1937 form of this test agreed as well with the 
composite judgment of counselors and administrators as did ratings 
made with the help of Haggerty-Olson-Wickman Behavior Schedules 
by instructors who had served as homeroom teachers of the pupils 
concerned for from two to five semesters. Low but statistically 
significant correlations with problem-behavior were also found for 
scores on the Bell Adjustment Inventory and three subsections thereof, 
the Sims Score Card for Secio-Economic Status, and the dominance- 
submission scale B4-D of the Bernreuter Personality Inventory. 
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THE MEASUREMENT OF OVERLAPPING 


J. W. TILTON 
Yale University 


Ordinarily, the extent to which one distribution overlaps a second is 
represented by the percentage of scores in the first which either equal or 
exceed the median score of the second distribution. This measure is 
unsatisfactory because it has a variable and undefined relation to the 
total amount of overlapping. Its maximum value, fifty per cent, 
describes one hundred per cent overlapping. But when twenty-five 
per cent of one distribution equals or exceeds the median of the second, 
(see Figure I) the two distributions overlap to the extent of seventy- 
four per cent, in the sense that the scores of seventy-four per cent of 
either group may be matched with scores from the other group. In 
other words, the shaded area in Figure I, which is the area of overlap- 
ping, is seventy-four per cent of the area under either frequency curve. 
When only nine per cent reach or exceed the median, (see Figure IT) still 
the two groups are as much alike as they are different in the sense that 
they are alike in fifty per cent of the cases. A fully or adequately 
measured overlapping of nineteen per cent (see Figure III) would 
ordinarily be reported as zero overlapping since, under these conditions, 
less than one-half of one per cent of one distribution might be expected 
to reach or exceed the median of the other. 

Symonds! has suggested the use of bi-serial r as a measure of over- 
lapping, after considering, as an alternative, the difference between the 
means of the distributions. Bi-serial ris a good substitute for the usual 
method of measuring overlapping, except for the fact that its minimum 
value .00 is a measure of maximum overlapping and 1.00 indicates less 
than one-half of one per cent of one distribution equalling or exceeding 
the mean of the other. In Figure 1 of Symond’s article, it is incorrectly 
represented as superior to the common measure of overlapping from 
the standpoint of reliability. This is due to the fact that Symonds 
used as the standard error of the per cent of overlapping, , Re + ae 

1 2 
The .25/N, should be multiplied by the ratio of the ordinates of the 
distributions at the median. When, in the case of two normal dis- 
tributions of equal populations, the overlapping is complete, the ratio 

1 Symonds, P. M.: ‘‘A Comparison of Statistical Measures of Overlapping with 


Charts for Estimating the Value of Bi-serial r.” Journal of Educational Psy- 
chology, Vol. X XI, pp. 586-596. 
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omitted equals 1, and its omission introduces no error. But as the 
overlapping decreases, the ratio approaches zero, and appreciably 
reduces the standard error, as may be seen in Kelley’s! Table LX XI. 
Had Symonds used these more accurate values of the standard error 
of the per cent of overlapping, bi-serial r would not have been repre- 
sented as a more reliable measure of overlapping. 

The chief limitation of bi-serial r is the limitation, already described, 
of the common percentage measure of overlapping for which it is 
offered as a substitute. When it has increased to 1.00 there is still 





























ORDINARILY REPORTED AS 25% ORDINARILY REPORTED AS 0% 
F16.z */6. Tr 























A 

; ° x + 
ORDINARILY REPORTED AS 9% Muy MN, 
*/6.2 F622 


nineteen per cent overlapping of distribution areas as previously 
illustrated in Figure III. It is true that the formula can be used when 
there is less overlapping. When bi-serial r is 1.18 or greater there is 
less than one-half of one per cent of overlapping area, or, for practical 
purposes, no overlapping. But the incorrect use of a correlation 
formula to give values greater than 1.00 does not commend itself. 

The difference between means in sigma units is a very good measure 
of overlapping. With such a measure, a person familiar with the rela- 
tion of the standard deviation to a normal distribution can reconstruct 
a very satisfactory picture of the overlapping measured. For the 
statistically untrained the measure is unsatisfactory. For them it 
emphasizes only the difference between the groups. Because of this 
fact, the comparison of means should be supplemented whenever 
possible by an explicit measure of overlapping, such as the percentage of 
area common to the two distributions, which is, in other words, the 





1 Kelley, T. L.: Statistical Method. New York: The Macmillan Company, 1924, 
p. 319. 
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percentage of scores made by one group which could be matched with 
scores in the other group. 

This full measure of overlapping is often the one wanted in educa- 
tional comparisons. Starch’ used it to describe the overlapping 
of school grades. Burr? could have used it to very great advantage to 
supplement his graphic portrayal of the overlapping among “homo- 
geneous’’ sections instead of the ratio of section to grade range. Ter- 
man and Miles* used a measure which is equal to one-half of the total 
percentage of overlapping. 

Assuming the need for such a measure, the writer suggests that it 
be obtained as for normal distributions separated by the number of 
sigma scores between the means of the overlapping distributions. For 
two overlapping normal distributions of equal N and equal sigma, as in 
Figure IV, the intersection lies midway between the means. The 
percentage area on either side of ‘‘Z” at the point of intersection, 7.e., 
of p: or p2, may be read from a table of the normal probability integral. 
The desired entry is one-half the sigma distance between the means. 
Twice this area, 7.¢., p1 + ps2, is the full measure of overlapping desired. 

Table I* has been prepared to serve three purposes: To save the 
reader the necessity of halving the sigma distance between the means, 
and doubling the integral found in a probability table; to facilitate the 
computation of standard errors (column four); and to show the relation 
between the full measure of overlapping (column three), the customary 
measure (column two), and the sigma distance between means (column 
one). In other words, for each per cent of overlapping, in column 
three, is given: in column one, the difference between means in terms 
of sigma for which it is appropriate; in column two, the corresponding 
measure of overlapping as it has been commonly defined; and in column 
four, the ~/N times the standard error of the desired percentage found 
in column three. 

Since the table is based upon the assumption of normality, and of 
equality of N and sigma, the desirability of its use is certain for only 
those situations in which departure from normality and from equality 


1 Starch, D.: Educational Psychology. New York: The Macmillan Company, 
1926, p. 36. (And in the 1928 revision, on p. 37.) 

* Burr, M. Y.: A Study of Homogeneous Grouping. (Contributions to Educa- 
tion, No. 457.) New York: Teachers College, Columbia University, Bureau of 
Publications, 1931. 

* Terman, L. M., and Miles, C. C.: Sex and Personality. New York: McGraw- 
Hill Book Company, Inc., 1936, p. 67. 

‘The Kelley Wood Table was used in the preparation of Table I. Kelley, 
T. L.: Op. cit., pp. 373-385. 
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of N and of sigma are not significant. In expressing the difference 
between means as a sigma distance, the use of the average sigma is 
recommended. It may be necessary to modify the procedure to fit 
other situations, but because of the simplicity of the method it is to be 
hoped that it will prove satisfactory in most situations. The fact that 
the proposed percentage does not exactly equal the percentage found 
by the method of counting, is for most purposes an advantage rather 
than a disadvantage. For theoretical purposes, it is frequently more 
desirable to know what tne overlapping would be for normal distribu- 
tions of the same or equal populations, than to know by counting what 
it is in the actual situation. 

In those cases where means and sigmas (or Medians and Q’s) are 
already computed, the ease of computation is obvious. This fact 
makes the method very useful, for there are many cases of reported 
data to which it may be applied with profit. For instance among the 
valuable data presented by Byrns and Henmon! are the facts that 
six thousand twenty-eight high-school seniors whose parents were in 
professional occupations made a median scholastic aptitude score of 
68.5, Q equal to 23.5, and that thirteen thousand whose parents were 
unskilled laborers made a median score of 45.8, Q equal to 24.5. The 
average Q, 24.0, is equivalent to a sigma of 35.5. The difference 
between the medians is 22.7 or .639 of a sigma. Table I shows, for 
.639 the interpolated value 74.9 as the per cent of overlapping. The 
average N = nine thouasnd five hundred fourteen and the square root 
of this N is 97.5. The column four value for 74.9 is 56.3, which, 
divided by 97.5, gives .6 of one per cent as the standard error of the 74.9 
percent. In this case, the authors show by their conclusions that they 
are aware of this large degree of overlapping, but, without a measure, 
readers often fail to realize it and authors may even prevent a realiza- 
tion of similarity in groups by an emphasis upon the difference between 
them. For instance, Pintner? quotes army testing data from the Mem- 
oirs* to show the “marked” difference between those from northern 
Europe and those from southern Europe. It isn’t that the difference 
is not significant, but that it is less marked when viewed with the fact 





1 Byrns, R., and Henmon, V. A. C.: “Parental Occupation and Mental Ability.” 
Journal of Educational Psychology, Vol. XXVII, pp. 284-291. 

*Pintner, R.: Intelligence Testing. Revised Edition. New York: Henry 
Holt and Company, 1931, pp. 460 and 467. 

* Yerkes, R. M., Editor: ‘‘ Psychological Examining in the United States Army.”’ 
Memoirs of the National Academy of Sciences, Vol. XV. Washington: Government 
Printing Office, 1921, p. 699, Table 218. 
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that between the Italian group on the one hand, and the Denmark, 
Norway and Sweden group on the other, there was a 65.3 per cent 
overlapping. 

Another good feature of the method of computing the per cent of 
overlapping proposed in this article is the ease with which correction 
may be made for differences in reliability as suggested by Kelley.' 
Suppose two groups are tested with three tests—a completion, an arti- 
ficial language, and an analogies test—in order to find out in which trait 
the groups are most alike and in which trait most different. For 
illustration, means and sigmas may be taken from Livesay’s? compari- 
sons of Caucasian and Part-Hawaiian groups. At face value they 
supply the answer that the groups overlap most on the artificial 
language test and least on the analogies test, the percentages being 
87.2, 75.5, and 75.2. Since the reliabilities are given, the true sigmas 
may be computed by the use of the formula: 


go = 0r/r* 


The differences between the means in terms of the true sigmas are 
greater and the overlappings less. The 87.2 becomes 87.1, 75.5 
becomes 72.9, and 75.2 becomes 73.4. In terms of true overlapping the 
fact remains that the groups differ least in their artificial language 
scores, but it now appears that they differ most in completion scores, 
instead of in analogies scores. In this case the effect of the correction 
is slight because the reliabilities were all high, but it will be evident that 
in such problems the use of true sigmas may make significant differ- 
ences in the amount of overlapping. 

The standard error of the suggested percentage of overlapping is 
derived as follows: Let the distributions of Figure IV be normal and 
their populations equal to 1. The overlapping (Ov.) is the area p, plus 
P2 OF, since Pp; = P2, Ov. = 2p. SD 2por2SD pis then the SE desired. 
If it were being suggested that Ov. be obtained by a counting method, 
its error would be due in part to the SE of a per cent, +~/ pq/n, and due 
in part to the error in the location of the ordinate separating p; from 
P2. However, the counting method is not recommended. It is sug- 
gested rather that the overlapping reported be that for two perfectly 





1 Kelley, T. L.: “(Measurement of Overlapping.” Journal of Educational 
Psychology, Vol. X, pp. 229-232. 

*Livesay, T. M.: ‘Racial Comparisons in Performance on the American 
Council Psychological Examination.” Journal of Educational Psychology, Vol. 
XXVII, pp. 631-634. Table I, p. 632. 

* Kelley, T. L.: Statistical Method, number 166, p. 213. 
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normal distributions similarly separated. Its error, therefore, is due 
solely to the location of the point z. Assuming the distributions to be 
flat at the point of intersection,'! the change in p, or pz produced by a 
change in z, dz, iszdz. SE pis then SD z dz orz SD vz. 








me Mn, —— Mnz 
ex 28D 
For an SD of a ratio between two variables, Yule’s? formula is: 
Mn, 
SD? = Mn (v2? — 2rayaty + vy?) 


By substitution, assuming that r between numerator and denomina- 
tor = 0, and that r between measures in distribution 1 and distribu- 
tion 2 = 0, and by using the obtained numerator and denominator as 
means of the same, 


Mn; — Mnz _ 1 Mn; — Mn:2\? 
SE sp = ay ' + ( SD ) 


SE p = Zz 44 ‘me - ‘ann 




















24/2 SD 
z2 M m— M Ne 3 
Ja + (“a5”) 

The ~/N times this value is listed in column four of Table I. In 
the first line, for one hundred per cent it is 56.4. For fifty per cent 
overlapping, as usually defined, the corresponding value in Kelley’s 
Table LXXI* is 70.7. In his table, 10.5 is the value for one per cent. 
The corresponding per cent in Table I is 24.5 per cent and its 
/N‘SE is 44.0. In other words, the standard errors given in Table I 
are smaller for large amounts of overlapping and larger for the lesser 
degrees of overlapping. When the measures of overlapping are 
expressed as multiples of their standard errors, the proposed percentage 
is more reliable throughout the range of the measure ordinarily used. 
In this relative sense, the complete measure of overlapping proposed is 
1.8 times as reliable as the ordinary percentage in the case of one hun- 


dred per cent overlapping, and thirteen times as reliable for the smallest 
amount of overlapping listed in Kelley’s Table LX XI. 











SE Ov. = 2SEp = 





1 Following Kelley, T. L.: Statistical Method, p. 317. 

* Yule, G. U.: An Introduction to the Theory of Statistics, London: Charles 
Griffin and Company, Limited, 1922, p. 215, No. 10. 

* Kelley, T. L.: Statistical Method, p. 319. 











AN INVESTIGATION OF THE VOCABULARY PROBLEM 
IN COLLEGE BIOLOGY 


ELMO N. STEVENSON 
Eastern Oregon Normal School 


Is there a vocabulary problem in the study of general biology in 
college? Many observant, efficient teachers and most of the students 
of biology believe there is. They are cognizant of the great burden 
occasioned by the technical nomenclature, associated vernacular, and 
names of the contributing personnel of this subject. 

Research investigations on the junior and senior high-school levels 
have revealed the magnitude and indicated the possible-implications 
of the vocabulary problem there. Pressey! conducted the earliest 
extensive study of the science vocabulary found in widely used text- 
books. The investigator determined an “essential,” an ‘‘ accessory,” 
and an ‘‘auxiliary” vocabulary for various high-school sciences and 
other subjects by using an elaborate technique which employed teacher 
judgment principally. In commenting upon the length and difficulty 
of her vocabulary lists she quoted the opinion of foreign-language 
teachers to the effect that a pupil does well to acquire from eight hun- 
dred to a thousand new words in a foreign language; then states that. 
“the pupil in any of the sciences . . . has as great, or a greater, 
vocabulary to master, wholly aside from acquisition of considerable 
subject-matter.”’ In the science category, general science led with a 
total vocabulary of fifteen hundred sixty-four, and biology was next 
with thirteen hundred ninety-three. She concludes by indicating that 
the difficulty which children have in the sciences is frequently a mean- 
ing difficulty. 

Powers,” working coincidentally but using a more objective investi- 
gational technique, has contributed two extensive studies of the nature 
and difficulty of the vocabulary found in high-school science text- 
books. His first investigation was an analysis of more than a million 
running words in textbooks of general science, chemistry, and biology, 
to determine the number and frequency of appearance of uncommon 
words. He concludes, ‘‘It can hardly be denied that the vocabulary 





1 Pressey, Luella C.: ‘‘The Determination of the Technical Vocabularies of the 
School Subjects.” School and Society, Vol. XX, July 19, 1924, pp. 91-96. 

? Curtis, F. D.: Second Digest of Investigations in the Teaching of Science, 
Vol. II, pp. 348-351. 
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burden of all science texts is unnecessarily large.’”’ He suggests that 
this vocabulary difficulty be reduced by substitution of phrases for 
technical terms, and by the introduction of ‘“‘only such technical 
terms . . . as the authors find need for after they are introduced.”’ 

Powers’s second investigation' was an extension of his previous 
study to include an analysis of more texts, scientific books, and period- 
ical articles. His object was to determine ‘‘a list of ‘uncommon’ 
words found to be most important on the basis of range and frequency 
of usage in science texts and in other reading material about scientific 
subjects.”” He concludes that authors are using in their books many 
words which children will never see again after leaving the classroom, 
and that intelligent selection on the part of authors in regard to vocab- 
ulary load and difficulty “‘is of paramount importance in the work of 
adapting the materials of science textbooks to the ability levels of the 
pupils for whom they are written.”” He lists eighteen hundred twenty- 
eight ‘‘uncommon’”’ scientific terms which his analyses have shown to 
be important and which lie outside of Thorndike’s list. 

Baird? conducted an analysis of student’s biology notebooks from 
fifty representative secondary schools in New York State to determine 
the degree of agreement in vocabulary used in biology texts and biology 
notebooks as written by students, and to compare the scientific terms 
used in notebooks with those found in Powers’s List of Scientific Terms 
for High-School Students and with those in The Teacher’s Word Book. 
His technique consisted of constructing an initial word list against 
which he checked the vocabulary content of all the notebooks. He 
found that the total number of separate words used (names and 
symbols included) was two thousand three hundred fifty-eight. Of 
these scientific terms, six hundred forty-five were used in all notebooks. 
Most of them were used but once. He concludes that biology has a 
technical vocabulary more or less peculiar to it; that the acquirement 
of this vocabulary is difficult; and that the technical vocabulary of 
textbooks may well be simplified, especially since many words were 
not found in Powers’s list. 





1 Powers, S. R.: “Important Terms Compiled from Textbooks for General 
Science, Biology, Physics, and Chemistry, and from Other Reading Materials for 
Scientific Subjects.” Bureau of Publications, Teachers College, Columbia Univer- 
sity, New York, 1926. 

2 Baird, Don O.: “A Vocabulary Study of Biology Notebooks of Fifty Repre- 
sentative Secondary Schools in New York State.” Education, Jan., 1931, pp. 
263-269. 
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Recent writers of textbooks of high-school science have taken 
cognizance of the findings of Powers, Baird, Curtis, Pressey, and others. 
As a result, they are using a simpler vocabulary, a greater simplifica- 
tion of materials of instruction, and are attempting to secure a mastery 
of essential technical vocabulary through repetition. 

The author of this article conducted an investigation at the Eastern 
Oregon Normal School in general biology to determine whether 
or not a similar vocabulary load and difficulty existed on the college 
level. The course in general biology was a year survey course. The 
principal aims were to develop an understanding and appreciation 
of the living world; to develop a functional understanding of the major 
generalizations of biology and the development of associated scientific 
attitudes; and to provide the student with the practical information 
that a prospective citizen and teacher needs to adapt himself effectively 
to hisenvironment. The content consisted of a comprehensive survey 
of the lower plants and animals, and general principles of biology for 
the first quarter. The second quarter was devoted to the higher 
plants and animals, while the third quarter concerned human biology. 
The method of teaching used was a combination of the provlem, 
lecture-demonstration, discussion, and laboratory procedures. The 
textbook was Foundations of Biology by L. L. Woodruff. The chief 
references were: Animal Biology, by M. F. Guyer, College Zoology, by 
R. W. Hegner, Textbook of General Botany, by G. M. Smith and others, 
Applied Eugenics, by P. Popenoe and R. H. Johnson, and Manual of 
Biology, by G. A. Baitsell. 

The author’s procedure was to construct a master word list from 
weekly word lists handed in by students. These weekly lists were 
considered a part of the regular work. All unknown vocabulary 
items, technical or otherwise, encountered in the course were to 
be included. The students were informed that the purpose of the 
study was to improve the course by reducing the excessive vocabulary 
burden, if there was one. At the end of the quarter the master word 
list, directions for checking the words, and a request for a few responses 
to questions were given to each student. Only the directions and 


beginning of the master list are included here because of space 
limitations. 


Master List 


The following new words and phrases were encountered by students in 
their reading and lectures during the first quarter of a course in general 
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biology. This list was compiled from word lists handed in weekly. The 
word or phrase had to be mentioned by at least ten students to be included. 


I. Please answer briefly the following questions: 

a. Was the nomenclature of biology a serious handicap to you? 

b. Would you have liked the subject better if there had been fewer 
new and unfamiliar words and phrases? 

c. What percentage of these words do you think you will ever meet 
again outside of a biological science course? Underline: 0-25 per 
cent, 25-50 per cent, 50-75 per cent, 75-100 per cent 

d. Do you plan to take more courses in biological science? If so, do 
you still think as you have indicated above? 

II. Please go over the list and check the words as follows: 

a. Place a check mark (l) in front of all words which were new or 
unfamiliar to you at the beginning of the quarter. By unfamiliar 
is meant that you could not illustrate nor define the word. 

b. Place a cross mark (+) after the words which you think are neces- 
sary for an adequate understanding of biology. 

c. Place a minus mark (—) after the vocabulary item which, though 
not necessary for an adequate understanding of biology, helps to 
make for better elucidation. 


The List 
binocular Reptilia sulfur nitrates 
algae Aves phosphorus nitrites 
diatom Mammalia chlorine radiant energy 


These word lists were to be turned in on the final day of the 
quarter. Students were urged to define or describe as many of the 
terms as they could. Ample time was allowed for this. Many 
students conscientiously went through the list as suggested; others 
started, but gave up for one reason or another. 

The master list technique was carried out for the six quarters of 
the 1933-1934 and 1934-1935 school years. At the end of the fall 
quarter in 1934 a random sampling check list of twenty-five words to 
be defined was included in the final test to verify the checking procedure 
on the master list. The results indicated a high degree of correlation 
between what had been indicated as known with the degree of achieve- 
ment on the test list. The reason is evident. This device was used 
only the one quarter. 

The findings are presented in the accompanying tables with suffi- 
cient descriptive matter to make them understandable. The statistics 
have been reduced to the simplest processes. No attempt was made to 
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TasLe I.—Finpincs oN Worp FREequENciges ON Master AND WEEKLY Worp 
Lists, AND COMPARISONS WITH AUTHORITATIVE VOCABULARY LISTS 














School year 
Descriptions Fall Winter Spring 
1933 1934 1934 | 1935 | 1934 | 1935 
Vocabulary items on master iv 
list (frequency of at least Hl 
ten in class of thirty basis 

NS S « Seo sew Xe ba ees 1083 743 540 433 313 303 
Per cent less than corre- 

sponding quarter........|........ Sih Risse si Ok eae 3.2 
Range of checkingon master{ 162- 128- 103- 55- 115- 193- 

list—low to high. -1013 —687 -505 | -385 | -312 | -292 
Range of different vocabu- 213-~| 190- 151— | 101— | 202—- | 191- 

lary items on original| -2153 | -1503 | -1102 | -870 | -513 | -511 

weekly list (individual 

student totals). 

Mean of master list checks. .| 685.1 | 472.5 (351.4 (809.3 (228.6 (223.5 
Number of cases........... 66 71 56 63 29 31 
Per cent less than corre- 

sponding quarter........|........ DO Waseced lee Et 2.2 
Master list words in Power’s 

Ms Fi dce dees Seaweed 243 189 57 44 21 19 
Per cent of total on master 

ae pe deh oe be 22.4 25.4 | 10.6 | 10.2 6.7 6.3 
Master list words in Thorn- 

NL, «sect owe bean ee 67 23 9 5 3 3 
Per cent of total words on 

er ae ae 6.1 3.1 1.7 1.2 1.0 1.0 
Master list words in text 

Sk ods chai oo Samed 188 197 52 63 20 19 
Per cent of total words on ‘ 

EL, cae des 643 ao 17.4 26.5 9.6 | 14.6 6.4 6.3 
Percentage of Woodruff 

(text) glossary........... 34.75 | 43.68 | 11.529) 13.968) 4.434) 4.212 
Definable or describable 

terms at end of quarter. 

Ss nck puredans's 6 <h'ea4 598 570 381 397 222 283 
Number of cases........... 21 11 19 21 16 7 
Percentage of total master 

Be Seiseusibla dd bide tees 55.2 76.7 | 70.6 | 91.7 | 70.9 | 93.4 
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determine standard errors. Such procedures seemed to be unnecessary 
in view of the nature of the problem, the techniques used, and the 
purposes of the author in making the study: 

Several interpretations and generalizations may be drawn from 
the data presented in Table I. The vocabulary burden of general 
biology is tremendous. The greatest number of words listed by any 
student for the 1933-1934 school year was three thousand three hun- 
dred twenty-one. The accumulative mean for the corresponding 
period as revealed by the master word list check was twelve hundred 
sixty-five. The total listed on the master list was nineteen hun- 
dred thirty-nine. (Each of these words was listed by ten ior more 
students.) Over a thousand words were contacted in the first; quarter, 
half that number in the second quarter, and a third in the leat |\quester. 

Comparisons with authoritative vocabulary lists for eleipentary, 
secondary, and college students (text glossary) indicated tha: fifty to 
eighty-five per cent of the terms on the master list were not included. 
The comparison with Powers’s list, which is primarily a utilitarian and 
common frequency list, indicated that a large per cent of tl words 
contacted would have little value to the student in everyiiay life. 
The data suggested that the greater the vocabulary burden, th:; smaller 
the per cent of knowable terms there will be. Only fifty-five per cent 
of the words in the fall 1933 master list were definable and describable 
by the students, whereas seventy-five per cent of the fall 1934 master 
list, with its fewer words by thirty-one per cent over the 1933 list, were 
definable and describable. 

The data reveal a wide difference in vocabulary burden in the 
group of students concerned. Some have an excellent foundation of 
science vocabulary; others a poor one; and most of the students need a 
greater background of the vocabulary that appears to be peculiar to 
general biology for the best comprehension. The vocabulary burden 
can be cut down by using phrases and descriptions rather than technical 
words, and by eliminating nomenclature that is not met in life situa- 
tions. If this is done, the student takes an increased interest in the 
subject, and the course becomes more popular. This is desirable for 
the student who is not specializing in science. Even in his case there 
should be ample provision for increased vocabulary and learning, but 
not to the point of overloading or of losing his interest. 

A check was made in a German class in the same institution on 
vocabulary items, using much the same technique. The vocabulary 
burden for the first quarter was nearly four hundred words, not includ- 
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ing different forms of the same verb, and for the second quarter nearly 
eight hundred. The student of biology was expected to learn principles 
and facts of a subject field and develop attitudes and skills therein in 
addition to mastering a vocabulary as great as, and in many cases 
greater than, the student studying a foreign language. The progression 
is from the smaller to the larger number of words in the language. In 
biology the greatest vocabulary burden comes early in the course. 
Obviously, the difference in the nature of the vocabulary factors in the 
different subject fields must be recognized; i.e., similarity of symbols 
with known languages, continuity and development of meanings, 
functional value, etc. 

As a further check on the vocabulary burden, the author audited 
@ course in music appreciation and listed the words that were unknown 
Taste II.—Srupent OPINION ON THE VocaBULARY FEATURE OF GENERAL 


BioLocy in Norma ScHoou as DETERMINED BY RESPONSES TO QUESTIONS 
on A Master List 
































School year 
Questions Response 
1933-1934 | 1934-1935 
Num-| Per | Num-/ Per 
ber | cent| ber | cent 
Was the nomenclature of biology a seri-| Yes......... 128 (60.66 61 (56.48 
ous handicap to you? RE 83 |39.33| 47 (43.51 
Would you have liked the subject better | Yes......... 149 (70.95) 72 (67.92 
if there had been fewer new and un-/| No......... 61 |29.04| 34 (32. 
familiar words, names, and phrases? 
Do you plan to take more courses in| Yes......... 122 |60.69| 83 (82.17 
biological science? nts wae hia 79 (39.30) 18 }17.82 
If so, do you still think as you have| Yes......... 126 |91.97) 75 (90.36 
indicated? RS ee 11 | 8.02} 8 | 9.63 
Percentage 
What percentage of these words do you 0- 25 96 46.60) 31 |30.09 
think you will ever meet again outside 25- 50 83 |40.29| 47 /45.63 
of a biolowical science course? Under-| 50— 75 24 (|11.65) 25 (24.27 
line, 0-25 per cent, 25-50 per cent, 75-100 3 | 1.45) O /|00.00 
50-75 per cent, 75-100 per cent. 
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to him. (He had escaped most of the contacts with music usually 
afforded astudent.) There were three hundred twenty-one new vocab- 
ulary items enumerated. In a graduate course in zoology at the Hop- 
kins Marine Station the author, with a biology minor, checked three 
hundred forty-three unfamiliar terms during one quarter. During a 
quarter course in forest botany and distribution he learned more than 
three hundred new terms. There are few courses other than those in 
beginning science, especially the survey types, that have an excessive 
vocabulary impediment. 

Table II gives the data on student’s responses to questions asked 
on the master list. A majority percentage say that the nomenclature 
is a serious handicap. About seventy per cent would like the subject 
much better if the vocabulary burden were lessened. Seventy-five 
to eighty per cent of the students expect to meet fifty per cent or less 
of the words outside of science courses. Even though students con- 
template further course work in science, they still feel the same. 

A superficial attempt was made to determine whether there was 
a significant difference in vocabulary burden of students in the different 
quartiles, based on the Thurstone Psychological Test. Table III 
presents the results. 

TaBLe II].—Megans For THE ToTraL Worps LISTED DURING THE 1933-1934 


ScuHoou YEAR BY TEN StupENTs (RANDOM SAMPLE) IN EacH OF THE QUARTILE 
GROUPINGS. QUARTILE Four 1s THE HicHEeR ONE 


\ Quartile 








I II III | IV 











Nc Viiwdsebiutien 5 ab Wenes o's 1270.9 1270.2 1120.2 | 1275.4 





The difference between the first, second, and fourth quartiles is 
insignificant. The difference between the third and fourth is the great- 
est. Apparently, the vocabulary burden is equally great for a: evels 
of student intelligence. Further study should be made on this phase 
of the problem before any definite conclusions may be drawn. 

The means of the 1933-1934 and 1934-1935 populations as based 
on the Thurstone Psychological Examination showed a difference 
of five points. This would indicate that the groups were comparable. 
The comparative scores on the Codperative General Biology Test for 
1933 and 1934 were one hundred five and one hundred ten respectively. 
These tests were given at the end of the school year. The population 
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with the reduced vocabulary burden performed best. The same 
form was given for both school years. 

The data for the fall quarter of the 1933-1934 school year indicated 
that those students who came from the large towns and had taken 
biology had shorter word lists than those from village schools. The 
mean difference was one hundred sixty-seven words. Those who had 
taken biological science in high school had shorter lists than those who 
had not. Generally speaking, the poorer students’ (class performance) 
word lists were briefer than those of the better students. This might 
be due to procrastination, functioning of defense mechanisms, lack of 
coercion, etc. 

The master lists of those students (seventy-three) who completed 
the 1933-1934 school year were analyzed to determine which words 
were checked most frequently as being new and unfamiliar to them at 
the beginning of each quarter. Slightly more than six per cent of the 
first quarter’s words received a unanimous vote, as did nine per cent of 
the second and eleven per cent of the third quarter’s words. Less 
than three per cent of these new and unfamiliar words are found in 
Powers’s list. This evidence indicates that the number of new and 
unfamiliar words common to all increases progressively with the study 
of biology, and that a little over ninety-seven per cent of these new 
words have slight functional value. 

The same selected lists were used for an analysis of the words 
checked by the students as necessary for an adequate understanding 
of biology, or as being not necessary but helping to make for better 
elucidation. The results indicated that the students were good judges. 
Nearly eighty per cent of the words checked by seventy-five per cent 
of the students as being essential were found in Powers’s list. Only 
a small percentage of the words checked as not necessary but helping 
to make for better understanding of the subject was found in Powers’s 
list. Teachers of biology will agree with these judgments. 

In the form of concluding generalizations, the author wishes to offer 
the following: 

1. The vocabulary burden in general biology on the college level 
seems to be enormous, just as it is on the high-school level. 

2. The intensity of the burden varies with the individual student. 

3. Understanding, appreciation, achievement, and interest func- 
tion best under a reduced vocabulary impediment. 

4. A large percentage of the biological terminology is low in func- 
tional value. 
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5. The authors of college texts for first-year students could reduce 
the vocabulary burden by substituting phrases and descriptions for 
technical words. 

6. Instructors of elementary and orientation courses will secure 
more interest and better performance or understanding if they consider 
the vocabulary item in class, laboratory, and outside reading assign- 
ments. Too often the scholarly performance of the professor is on 
display. Understanding and interest on the part of the student are far 
worthier goals. 

7. There are psychological aspects of the problem which inhibit 
the student’s best performance and should receive attention through 
further research and philosophical treatment. 

8. The author apologetically presents the above, knowing full well 
the weaknesses of his techniques and the flimsy grounds upon which he 
dares to present his conclusions. He hopes that some of the techniques 
presented may be usable, perhaps modified, for subsequent, more 
scholarly and accurate experiments in the vocabulary problem. 














~ ot 


OO DD DO mm 





THE USE OF SUBCORRELATION IN DETERMINING 
THE PREDICTIVE POWER OF HIGH-SCHOOL GRADES 


P. 8. DWYER 


University of Michigan 


Many studies have dealt with the correlation existing between 
high-school record and first semester academic success. Quite com- 
plete summaries have been given by such authors as Segel! and Wagner.? 
They seem to agree that the bulk of the coefficients of correlation range 
from about .30 to about .70 with the average about .55. A study of the 
results leads one to surmise that the predictive power is better for more 
homogeneous groups. ‘Thus, for example, the predictive power tends 
to be relatively high at the urban university which draws the major 
portion of the student body from the city in which it is located. 
Degree of homogeneity as to age, sex, etc., also appears to influence the 
size of the coefficient. 

This fact leads to the suggestion, and it is by no means a new one, 
that better predictive power may sometimes be obtained by making 
subdivisions of the student records into less heterogeneous groups. 
This alternative to the method of partial correlation is hardly applica- 
ble to the small college, but it can be applied to the large university. A 
fairly recent study using this method is that of M. E. Wagner and 
E. Strabel at the University of Buffalo. For a description of the 
groups chosen and the results, see their article in School and Society.* 

The technique used in this paper is not homogeneous grouping in 
the sense previously used, although the objective, the separation into 
groups of comparable elements, is similar to it. It is here proposed to 
break up the distribution into subgroups which are approximately 
linear and homoschedastic, since linearity and homoschedasticity are 
necessary if r is to measure uniform predictive power. The correlation 
coefficients for these linear and homoschedastic subgroups are to be 
known as subcorrelations. 





1Segel, David: Prediction of Success in College. Office of Education Depart- 
ment of Interior, Washington, D. C., Bulletin 1934, No. 15, pp. 69. 

2 Wagner, M. E.: ‘A Survey of the Literature on College Performance Predic- 
tion.”” Chap. 13 of Studies in Articulation of High School and College. E.8. Jones, 
Editor, University of Buffalo Studies, Vol. IX. See pp. 194-196. 

* Wagner, M. E. and Strabel, E.: ‘‘ Homogeneous Grouping as a Technique for 
Improving Prediction Coefficients.” School and Society, Vol. XL, 1934, pp. 
887-888. 
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The files of the office of Educational Investigations of the University 
of Michigan supplied information dealing with high-school grades and 
freshman first semester grades for those students entering the School of 
Literature, Science, and the Arts in 1926. Tk2 hig..-school record is 
used as the y variable and the college record is used as the z variable in 
Table I. The grades are grouped in one-half unit intervals which are 
characterized by class marks. Entries are made for each row under 
the headings f, Zfd., (Zfd.)d,, fd,, Xfd.*, fd,?, and the results summed 
for all rows which are combined in the subgroup. The subcorrelations 
are obtained by the use of the formula 








fzfd.d, — (2fdz)(Zfd,) 
R:ki, ks, °° + k) = 
’ ) ~ Visas’ — (fas) M20, — Cay" 
where k,, ke, . . . k, are the class marks of the rows combined. 


The application of the test for straightness of regression line! does 
not definitely establish the significance of deviations from the straight 
line, though a study of a large number of similar charts reveals the 
consistency of these deviations. In addition the charts show a moder- 
ate degree of heteroschedasticity with the top rows having somewhat 
smaller variances. 

Further study of these charts shows that the conditions of linearity 
and homoschedasticity are more nearly satisfied when the rows having 
class marks of 8, 7, 6 are selected, when those having class marks of 
5,,4 are selected, and when those having class marks of 3, 2, 1 are 
selected. The detailed calculations of the value of r for these sub- 
groups are shown in the lower righthand corner of Table I. ; 

The first of the triple entries is a three- or four-place approxim:.tion 
to frfd.d, — (Zfd.)(Zfd,). The two entries below are corresponding 
approximations to f2fd.? — (Zfd.)? and fxXfd,? — (Zfd,)?, respec- 
tively. The first entry in the next column is the subcorrelation. 

The values are then: 


r = .441 

r(R:8, 7, 6) = .288 
r(R:5, 4) = .156 
r(R:3, 2) = .007 


These values are not comparable measures of predictive power. 
Comparable measures might be derived by computing the coefficient of 





1 Fisher, R. A.: Statistical Methods for Research Workers. 5th edition, pp. 
239-243. 
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a distribution whose y standard deviation is equal to the y standard 
deviation of the original distribution and yet whose linearity and 
schedasticity are identical with those of the subdistribution. These 
measures, r’(R:k:, . . . k,), are to be called corrected subcorrelations 
and are computed from the formula 


r(R:ki, - °° k,) = 
r(R:ki, - - + ke) 
Vc22(R:ki, - * * ke)[1 — r2(R:ki, - ~~ ke) +r2(Riki, ~~ ke) 


where c2"(R:ki, . . . k,) is the ratio of the y squared standard devia- 
tion of the subgroup to the y squared standard deviation of the entire 
distribution. 

An alternative measure is the squared standard deviation of errors 
of the subgroup. It is given by the formula 


Si(R:hi, + + + ks) = 01%(Rzks, + +» ky)[1 — r°(Rzk, «+ + ha) 








The further entries in Table I show the computations necessary to 
determine these measures. The entries under r(R:k,, . . . k,) are 
r?(R:ki, - + + k,)andl —r?(R:ki, - + - k,), respectively. The entries 


2 2 2 2 
in the next two columns are 2fds ’ 2fds 2 = 2fd.t — (4) and fd," 
n n n n n 
Tidy. Za? (34) 
ah. I de = a ~ as 


column are ¢22(R:ki, + + + k,), ¢2?(R:ki, - + + k)[1—7r?(R:ki, - - - k,)] 
and 


co2(R:ki, > + > k){1 — r2(R:ki, + - + ke] +7r2(R:ki, - + + k,), 





» respectively. The entries in the next 


respectively. The entries in the next column are 


Ve2(R:ki, --- kl —r2(R:ki, -- k)] +r2(Riki, - + + ky) 


and 7r’(R:ki, . . . ks), respectively. The entry in the last column is 
S*(R:ki, . . . he). 

The results of Table I are given in Table IT. 

It appears that there is not much range in the standard deviation 
of errors although the top group has a slightly smaller value than the 
others, but there is a decided range in the size of the corrected 
subcorrelations. 








1 Compare Kelley Statistical Method, p. 225. 
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TaBLeE II.—SvUBCORRELATIONS BETWEEN HicuH-scHoo, GRADES AND First 
Semester Recorp ror CoLiecn or LireraTuRE, SCIENCE, AND THE 
Arts, UNIvERsITY oF Micuican, 1926 








Group (high school) f r r’ S;? 
Diiticsina ceees's aio 0 6c eks Via bess he 1126 44 44 2.19 
CE ih 6+ 0b a cdiess bande asm mcenecs 302 .29 56 2.07 
I Bests asso ddda oi hc tbe whe ncacads 600 16 40 | 2.22 
Ds 5 a oick tnd head  tbecine cis 224 01 02 2.14 

















The increased predictive power of the top group is largely due to 
the decreased slope of the line of regression, while the decreased predic- 
tive power of the bottom group is due to the increased slope of that 
line. It should be noted that the study deals only with the predictive 
power of high-school grades in the case of those students who are 
admitted to college. The correlation would be much higher if those 
high-school students who would surely fail were permitted to enter 
college. It is probable that the low correlation for the low group is 
due to the fact that those in the lower brackets have been admitted to 
college by admission officers who felt that there were reasons for dis- 
counting the high-school record. The result probably indicates a 
partial justification of their judgment. 

The decreased slope which is revealed by the corrected subcorrela- 
tion of the top group, but not by the squared standard deviation of 
errors, is very important. In problems where the standard deviation 
of errors is not small, there is little chance of satisfactory prediction, 
even by groups, if the slope of the line of regression is not small. A 
small slope enables one to establish correspondence between the differ- 
ent ranges of the zand y scales. None of those making A in high school 
made less than C in college. 

The question next arises as to the representativeness of this enter- 
ing class of 1926. Do the classes entering in later years show the same 
tendency? Do other schools in the University show the same tend- 
ency? Do other colleges in Michigan show the same tendency? 

The correlation tables for the years 1927-1930 are also available in 
the Office of Educational Investigations of the University of Michigan. 
In addition to the correlation coefficients, which the staff had previously 
computed, the subcorrelations were computed, as in Table I, for all 
freshmen entering the college of Literature, Science, and the Arts in 
the years 1926-1930. 
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TaBLe III.—SvuBcORRELATIONS BETWEEN HIGH-SCHOOL AVERAGE AND First 
Semester CoLttece RecorRD FOR FRESHMEN OF THE COLLEGE OF 
LITERATURE, SCIENCE, AND THE ARTS ENTERING THE UNIVERSITY 

OF MICHIGAN IN THE YEARS 1926-1930 











Group (high school) f r r’ S;? 
tive paedk sas Sivan co Oe Sie ab Guts 4848 44 44 2.14 
Ee, CNG MNDE ws owcvdkeiede ke cdee bax wiewe wien 1571 .33 .62 1.89 
ds cdVAcd bebois ds pSNbbdoescuewes 2546 16 .40 2.17 
BS; BB Gen the OP i ete is ec aes ee eos 731 02 .05 1.87 














It appears that 1926 was a representative year. 

The freshmen entering the College of Engineering in the same period 
constitute another group which can be studied by this technique. The 
results are presented in Table IV. 


TasBLE IV.—SvUBCORRFLATIONS BETWEEN HIGH-SCHOOL AVERAGES AND First 
SeMEsTER RECORD FOR FRESHMEN OF THE COLLEGE OF ENGINEERING 
ENTERING THE UNIVERSITY OF MICHIGAN IN THE YEARS 1926-1930 








Groups (high school) f T r’ S;? 
Do. xin RE ks + Sara Mies Mataceinn ooo 2kee 1275 .42 .42 2.22 
Cn 0G. bs 6M e wath s tawaee sc cee et 349 .33 .63 1.77 
Es ve 04.2 o Ms bo OE ONS.0 Ow od Rs ob ee 705 .19 44 2.35 
Ts ER a ee 221 .07 .22 1.94 

















The same basic tendencies appear though the low group seems to 
have better predictive power than indicated above. 

The results of an analysis of the records of all students entering 
the academic schools of the University in 1927-1930 are given in 
Table V. 


TaBLe V.—SUBCORRELATIONS BETWEEN HIGH-SCHOOL AVERAGE AND First 
Semester Recorp FOR FRESHMEN ENTERING THE UNIVERSITY OF 
MICHIGAN IN THE YEARS 1927-1930 








Group (high school) f r r’ S;? 
Re, lee ie Ak ar Tl ee ea kw cabs oa 5238 43 43 2.10 
FS! NPP eee ae ee eee 1728 31 .60 1.86 
EE ME i sn 5 x'y aig ee « Mae ae b> 0 2781 .17 41 2.15 
ee ee 729 .05 15 2.19 
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It appears that the highest preparatory-school group has the best 
predictive power as indicated by the corrected subcorrelation and by 
the standard deviation of errors. The predictive power of the average 
group is about that of the entire distribution as measured by the cor- 
rected subcorrelation and by the standard deviation of errors. The 
lowest group has about average standard deviation of errors, but the 
increased slope of the line of regression makes a small correlation. 


TaBLE VI.—SUBCORRELATIONS BETWEEN HIGH-SCHOOL AVERAGE AND FIRsT 
Semester CoL_iece Recorp FoR FRESHMEN ENTERING TWENTY MICHIGAN 
CoLLEGEs IN 1928 








Group f r r’ S;2 
ED era pare ee 4951 .49 49 1.78 
eT en te eae 1459 | .28 | .57 | 1.57 
A, fs chsh doh Ue wivaa cae. 2649 | .17 | .40 | 1.84 
oe EE eS aaa 843 | .08 | .27 | 1.89 

















TaBLE VII.—CorreEcTED SUBCORRELATIONS BETWEEN HIGH-SCHOOL AVERAGE 
AND First Semester CoutueGE Recorp ror FRESHMEN ENTERING 
DiFFERENT MICHIGAN COLLEGES IN 1926-1930 








1926 1926-1930 
Literature, | Literature, | 1926-1930 | 1927-1930 1928 
Group Science and | Science and | Engineering) _ totals, twenty 
Arts, Uni- | Arts, Uni- | University | University | Michigan 
versity of | versity of |of Michigan|of Michigan| colleges 
Michigan | Michigan 
bcuMa « thks 68 44 44 .42 43 .49 
Mee ds «chee os .56 .62 .63 .60 .57 
atdadD » at'iwn .40 .40 44 Al .40 
Re .02 .05 .22 15 .27 




















The next question concerns the applicability of this technique to 
other institutions. In order to show that this same tendency does 
exist in other schools, at least in the State of Michigan, I have subjected 
to a corresponding analysis the records of freshmen entering twenty 
colleges ana universities in Michigan in the fall of 1928. A report of a 
coéperative study was made by Ruth A. Brown,! formerly of the 





1 Brown, Ruth A.: ‘A Study of High-School and College Records of Freshmen 
Entering Twenty Colleges and Universities in Michigan in the Fall of 1928.” 
Journal of Michigan Schoolmasters Club, Vol. LXV, 1930, pp. 315-330. 
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Office of Educational Investigations of the University of Michi- 
gan. Page 325 of this report states that there is a correlation of 
.494 between average first semester college grades and grades in high 
school for the four thousand nine hundred fifty-one freshmen entering 
the twenty Michigan colleges. The correlation sheet was taken from 
the files and the subcorrelation coefficients computed. These are 
presented in Table VI. (A group of the 1928 University of Michigan 
freshmen is included in this study.) 

It thus appears that the same tendency is evident in other Michigan 
institutions. For purposes of comparison there is presented in Table 
VII a list of the subcorrelations given above. 


SUMMARY AND CONCLUSIONS 


1. The subcorrelation technique is applicable to the problem of 
predicting college scholastic success from high-school record. 

2. In Michigan the subgroup composed of the A and B high-school 
students has better predictive power than do other subgroups. The 
C subgroup has about average predictive power while the group of 
those below C has a low predictive power, since the line of regression 
has a large slope. This is presumably due to the fact that the admis- 
sions officers have admitted students from this group because other 
evidence outweighed the scholastic records. 

3. It is probable that the pattern described (or variations of it) 
is quite universal. In any case the subcorrelation method can be 
used in discovering the pattern and providing comparable measures 


in cases where the distribution is non-linear, non-homoschedastic, or 
both. 











COMPARATIVE SOCIAL ATTITUDES! 


MAURICE M. SMITH 


University of California 


While the promotion and development of desirable social attitudes 
is widely accepted as a major objective of social-studies instruction in 
the schools, little effort has been made to determine the nature of these 
attitudes or to measure the amount of change resulting from such 
instruction. For the most part we teach facts and assume a con- 
comitant development of attitudes.? But an attitude is in the nature 
of an evaluation, a point of view. There is a logical basis for question- 
ing the inevitable concomitant origin of attitudes and certain evidence*® 
has been reported which challenges this assumption. 

A study of the social attitudes of high-school seniors was undertaken 
in California to throw light on these general problems, but more specif- 
ically to discover the nature of the social attitudes of graduating high- 
school seniors, and to compare their attitudes with those of high-school 
teachers, parents of high-school seniors, and professional social scien- 
tists in the universities and colleges of California. 

Using approved techniques, there was constructed for the above 
purposes a social-science opinionnaire designed to sample significant 
aspects of five major social institutions, viz., the family, the school, the 
church, industry, and the State. Two questions were paramount; 
first, what are the more significant issues related to these institutions, 
and, second, upon which of these should high-school seniors have 
informed opinions. The principal sources used for a selection of basic 
issues were the studies of Hockett,4* Lee,® Billings,* and Recent Social 





1 The study here abstracted is reported in full in the writer’s doctoral disserta- 
tion, The Attitudes and Opinions of California High-School Seniors Toward Current 
Social Issues, written under the direction of Professor Noel Keys at the University 
of California, 1935. 

? Kelley, T. L.: Scientific Method. New York: Macmillan, 1932, p. 105ff. 

* Longstreet, R. J.: “‘An Experiment with the Thurstone Attitude Scales.” 
School Review, Vol. XLIII No. 3, March, 1935; pp. 202-210. 

‘ Hockett, John A.: A Determination of the Major Social Problems of American 
Life. Teachers’ College Contributions to Education. No. 281 New York: 
Bureau of Publications, Columbia University, 1927. 

5 Lee, Baldwin: Issues on the Social Studies. Teachers College Contributions 
to Education. New York: Bureau of Publications, Columbia University, 1928. 

¢ Billings, Neal: Determination of Generalizations Basic to the Social Studies 
Curriculum. Baltimore: Warwick and York, 1928. 
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Trends.! Some three thousand issues were selected from aa PES 
and classified under the headings of the five social institutions. : State- 
ments were written expressing opinions toward six hundred «jf these 
issues. This list was reduced to three hundred by eliminatirg over- 
lapping issues. 

The second question raised above was answered by competent 
judges. An additional one hundred of the statements were eliziinated 
through these judgments. Preliminary administrations of the remain- 
ing two hundred items disclosed eighty additional items which were 
unsatisfactory because of certain ambiguities of phrasing or standard 
deviations so large that group means would have proved of little value. 
In its final form the opinionnaire was composed of one hundred twenty 
significant controversial issues sampling aspects of our social institu- 
tions. Provision was made for recording individual opinion 
toward these statements as phrased on a five-point scale of 
agreement-disagreement. 

Under standard conditions the opinionnaires were administered to 
the four populations under consideration in the spring of 1935. The 
first included eleven hundred seventy-six high-school seniors represent- 
ing four urban, four town, and eight rural high-school districts of 
California. Two hundred eighty-eight parents of these seniors, one 
hundred ninety-two of their teachers, and eighty-three university 
professors from the academic departments of economics, political 
science, history, sociology, education, and psychology in leading 
California institutions constituted the other groups. 

An item analysis was made of the opinions thus secured. The 
pupil population was sub-classified according to sex, and into rural, 
town, and urban groups. Using five categories of opinion toward 
each item, frequency distributions were made for each item for all 
groups. The following deviation values were assigned® to the opinion 
categories: 


Strongly agree (with the statement as phrased) = +2 
Agree (with reservations) = +1 





1 White House Conference Report on Recent Social Trends. New York: Century, 
1934. 

?The judgment of the California State Advisory Committee on Secondary 
Education was secured to afford an objective selection of statements and to insure 
that these statements should come within the training of the average high-school 
senior. 

’ Likert, Rensis: ‘‘A Technique for the Measurement of Attitudes.” Archives 
of Psychology, No. 140, 1932. 
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Doubtful (equal uncertainty for or against) = 0 
Disagree (with reservations) = —] 
Strongly disagree = —2 


When the frequency distributions were weighted with these deviation 
values, mean and standard deviation scores were obtained for each 
group and each item. The preliminary treatment of these data 
revealed so few statistically reliable differences between the mean scores 
of the sub-groups of seniors that these were pooled and subsequently 
treated as one group. 

The treatment of the data was largely restricted to comparisons 
between the mean scores of the groups toward the statements under 
consideration. Many highly significant differences were found. These 
have been reported elsewhere.! 

A technique was needed which would express the total relationships 
among the four groups toward items relating to each of the five social 
institutions, and which would at the same time identify significant 
mean differences that are so apt to be obscured in any summation of 
test scores. The first of these requirements was met by adapting the 
usual correlation procedure to present data by pairing the mean scores 
of two groups toward the sameitems. As ordinarily used, however, the 
correlation technique has the weakness of any summation of test scores 
in that the identity of individual items is lost in the process. To 
overcome this inadequacy and to meet the second requirement stated 
above, a modification of the scatter diagram was made.? This con- 
sisted of writing the serial numbers of the items in the proper cells 
where the usual tally marks are placed. 


ATTITUDES TOWARD INDUSTRY 


The nature, form, and function which industry should take in the 
proximate future is a question that is engaging the attention of a 
thoughtful adult population. While no satisfactory solutions to 
present industrial problems have been forthcoming, yet the schools, 
through courses in civics or social studies, purport to adjust a younger 
generation to these adult realities. 

As a result of all the forces that have been at work on the high-school 
senior, both in school and out, what attitudes and opinions has he 
formed toward contemporary industrial problems? Are these opinions 





1§8mith, Maurice M.: Op. cit., p. 178ff. 
2 The author is indebted to Professor Robert C. Tryon, of the University of 
California, for suggesting this use of the scatter diagram. 
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similar to those of his parents, his teachers, or of professional students 
of such questions? Is there evidence that the school has been instru- 
mental in formulating pupil opinions? Is there evidence, as some 
claim, that leftist teachers are creating a new social order by establish- 
ing extreme positions in the minds of our youth? 

A tentative answer to such questions was attempted with thirty- 
six statements revealing group opinions toward the nature, form, and 
function of industry; toward the nature of desirable relationships 
between government and business, the private ownership of wealth, 
competition, business ethics, individualistic opportunities, working 
conditions, labor unions, and the like which were subsumed under the 
heading of industry. Statements such as the following were included 
under industry: 





Group means 





Opinion statement Stu- Teach-| Pro- 
arents 


dents ers | fessors 





Newspa.vers exaggerate greatly when they state 
that 5 per cent of the people own 95 per cent 
of all the wealth in this country............ .13 .12 —.41 | —.48 

The federal government should regulate adver- 
tising and prohibit the publication of false or 














misleading statements..................... 81 . 96 . 96 91 
Everyone who earns his own money has a right 
to spend it as he pleases................00. .54 .50 —.03 | —.48 





Coefficients of correlation were obtained between each pair of the 
groups by pairing their attitude scores toward each item. The total 
relationships thus obtained are presented in Table I. When it is 
recalled that these thirty-six opinion statements were chosen originally 
because of their controversial nature, the magnitude of the coefficients 
becomes even more than ordinarily significant. 

On questions of industry present data indicate a highly consistent 
agreement between high-school seniors and their parents, with only a 
slightly greater disparity between high-school teachers and university 
professors. Group opinions toward individual items reveal that 
parents favor private ownership of business with less governmental 
regulation, an extension of individualistic opportunities, and that they 
express, on the whole, lower standards of business ethics than do univer- 
sity professors and teachers. There is little evidence that the more 
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TaBLs I.—CorEFFICIENTS OF CORRELATION BETWEEN THE MEAN Scores oF 
Seniors, PARENTS, TEACHERS, AND PROFESSORS TOWARD THIRTY-SIX 
Optntion STATEMENTS RELATING TO INDUSTRY 

















Groups 
Seniors Parents Teachers 
IN oe ns < ays ob edad eawk soll .96 + .01 
SE ee aes ee .88 + .03 .90 + .02 
SEE pape rane eee * 87 + .04 .80 + .04 .93 + .02 








highly socialized attitudes of the professional students of industrial 
questions are being accepted by these high-school seniors. The total 
variance between the groups is indicative of basic philosophical differ- 


ences which conceivably could be highly influential in determining 
behavior. 


ATTITUDES TOWARD THE STATE 


That the present economic crisis is widening the functions of govern- 
ment beyond anything heretofore experienced in America is unques- 
tioned. The assumption of the responsibility for providing work relief, 
social security, industrial regulation, agricultural control, and other 
recovery acts are interpreted by many as the beginning of a new and 
more collectivistic era in which an ever-increasing burden of the respon- 
sibility for the public welfare should be shifted to governmental 
agencies. 

Thirty-eight items of the opinionnaire were concerned with atti- 
tudes toward the State. Included were attitudes toward the responsi- 
bility of the State in achieving the general welfare, the responsibilities 
and duties of citizens, the continuance of present governmental forms 
and divisions, the soundness of present court practices, the administra- 
tion of justice, law enforcement, the influence and regulation of public 
opinion-forming agencies, and the general function of government in 
the present economic crisis. These statements may be illustrated by 
those given in the table at the top of page 686. 

Total relationships between the opinions of the four groups toward 
the basic issues of citizenship and government are indicated in the 
correlation coefficients in Table II. These data indicate a greater 
disparity among the groups than was evident in the field of industry, 
but there is a fairly high correspondence between pupils and their 
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‘ 
i Group means 
\ Opinion statement Stu- oes eee ee 
i dents ers | fessors 
: Recent developments in all forms of transporta- 
i tion and communication have made unneces- 
‘s sary many of our existing forms of local 
fe I ii iin. «i'd 4 this ok CRO NS aK os os 12] .38 51 .79 
Public officials, whose offices require skilled or 
4 professional training, should be appointed 
i REE ROL SEAT — .09 .23 .64 .93 
Ke After good men have been elected to office the 
bs average citizen should tend to his own affairs 
y and let officials manage public affairs........ .23 | .48 | —.26| —.32 

















TaBLEeE II.—CoeErFFICIENTS OF CORRELATION BETWEEN THE MEAN Scores oF 
‘4 Seniors, PARENTS, TEACHERS, AND PROFESSORS TOWARD THIRTY-EIGHT 

} 

OPINION STATEMENTS RELATING TO STATE AND GOVERNMENT 











“t Groups 
Seniors Parents Teachers 
: EG cave be'v det acleusees saws .85 + .03 
" CS, lobe hoe Male es 6 dd salen .78 + .04 .78 + .04 
Professors be ls peat eae aro eae .45 + .08 .36 + .09 .72 + .05 














parents.. On the surface these total relationships would seem to lend 
support to the popular notion that social scientists are, on the whole, 
proponents of political and social doctrines opposed to or subversive to 
accepted principles of American government. This would be especially 

; true if the attitudes and opinions of parents, as a group, were taken as 
ie the standard of reference. 

An inspection of those specific items toward which differences of 
opinion between parents (and pupils) and professors (and teachers) are 
most marked, reveals that while all groups favor a wider assumption of 
responsibility by the federal government for the promotion and financ- 
ing of measures making for the general welfare of the people, economic 
security, work, sick and old age benefits, and the like, parents (and 
pupils) are consistently unwilling to assume a proportionate share of 
the responsibilities and the abridgments of personal rights and liberties 
i necessarily associated with a wider dissemination of public benefits 

a by the federal government. Social scientists on the other hand (and, 


RAN a: tae St A. z vos - 





Comparative Social Attitudes 687 


to a lesser extent, high-school teachers, also) tend to express attitudes 
which indicate a more adequate understanding of the conditions requi- 
site to the promotion of the general welfare by a federal authority. 
On the part of parents, as a group, “the promotion of the general 
welfare”? would seem to be a stereotyped phrase largely dissociated 
from reality. 

High-school seniors seem largely unaware of the influence which 
modern developments of transportation and communication are having 
upon local governmental units. There is likewise little indication that 
they are informed with reference to modern methods of handling crime, 
the treatment of criminals, or legal procedure and court practices 
favorable to the administration of justice. They agree with their 
parents, that the established order is good and should be maintained. 

On the whole, the opinions of the groups toward issues relating to 
state and government reveal a discouragingly negligible influence of 
the classroom in promoting attitudes among high-school seniors which 
are harmonious with those of more informed persons. 


ATTITUDES TOWARD THE CHURCH AND PERSONAL MORALITY 


Popular opinion depicts the youngsters of today as radically differ- 
ent from their elders in their ethical and moral standards, in the stabil- 
ity of their beliefs, in their attitudes toward religion, but there is 
meager evidence to indicate just how different the opinions of the 
present generation of high-school pupils are from their parents and 
teachers. 

In the present.study thirty-four items of the opinionnaire related to 
the church, to etMfics, and ideals of character and conduct. Included 
were such statements as: 





Group means 











Opinion statement Stu- R Teach-| Pro- 
arents 

dents ers | fessors 
Churches and ministers should confine their 
activities to religious matters and leave politi- 

PG cove tanceUNned ve Ureserces 55 .66 | —.03 | —.48 
The best rule for good conduct is to follow the 

promptings of one’s conscience............. . 36 .45 .03 | —.08 
A person who is forced to accept a salary lower 
than his real worth has a right to loaf on the 

Sy ESO Ba Giinwadiccdcaveccvcceses —.86 | —.85 | —1.12) —.9$ 
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Toward the issues raised in this section the mean opinions of the four 


groups were, on the whole, in striking agreement. The total corre- 
spondence is shown in Table ITI. 


TasB.LeE III.—Coerrricizents oF CORRELATION BETWEEN THE MEAN Scores OF 
Seniors, PARENTS, TEACHERS, AND PROFESSORS TOWARD THIRTY-FOUR 
Oprnton STATEMENTS RELATING TO THE CHURCH, RELIGION, AND Eruics 

















Groups 
Seniors Parents Teachers 
ee oe ks so i ea ae .97 + .01 
ED. 2". cle vb'c bas ols a kivare .91 + .03 .97 + .01 
NO 5g. oh cheek nwans anaes .78 + .05 .81 + .05 .95 + .01 








Such opinion differences as were found toward these questions sug- 
gest a higher idealism 2nd a greater appreciation of ethical, moral, 
and social values on the part of the teaching profession than on the 
part of high-school seniors and their parents, as a group. The differ- 
ences between high-school seniors and their parents are slight. Popular 
characterizations of high-school youths as a rootless, opinionless 
generation widely at variance with their elders, seem unfounded if 
present data are to be relied upon. 

: ATTITUDES TOWARD THE FAMILY 

A diminution of the influence of the family, as well as marked 
changes in the assumption of responsibilities by yoygg persons in their 
family relationships are widely presumed! to have paralleled recent 
observable changes in the economic function and form of the family. 

To discover the consensus with respect to this assumption, thirty- 
two items of the opinionnaire were selected to sample attitudes toward 
the function of persons in their family relationships, toward problems 
of marriage and divorce, illigitimacy, birth control, sex instruction, 
eugenics, the place of woman in industry, problems of home manage- 
ment, health, child care, discipline, duties, standard of living, and other 
similar issues. 

The following statements illustrate the type of questions raised in 
this section: 





1 Queen, S. A.: Social Organization and Disorganization. New York: Thomas Y. 
Crowell Company, 1935. 
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Group means 





_— ant Stu- P Teach-| Pro- 
arents 
dents ers | fessors 





High schools should give detailed sex instruction 
to prepare students more adequately for 
SED. « n v.cs vse vnudeleae elanes pbs dive d's .65 54 . 26 .37 

Each community should establish Mother’s 
Health Clinics to furnish mothers with scien- 
tific birth control information and to distrib- 
ute supplies at cost or according to one’s 
NO I, i nat snc ehde dine ahntitay <b 0 . 86 .66 .74| 1.08 

A man should not ask a girl to marry him until 
he is earning enough to give her all the com- 
forts and little luxuries that are so necessary 
to a woman’s happiness................... .58 .42 —.28 | —.62 

















Certain high-school districts in California (Sacramento, Berkeley, 
and Alameda) objected to this section of the opinionnaire on the 
grounds that for the schools, these were unmentionable issues. The 
action of these schools is particularly interesting in view of the high 
agreement discovered between the groups toward these items. These 
relationships are indicated in Table IV. It is noteworthy that these 


TaBLE IV.—CoEFFICIENTS OF CORRELATION BETWEEN THE MEAN ScORES OF 
Seniors, PARENTS, TEACHERS, AND PROFESSORS TOWARD THIRTY-TWO 
Opinion STATEMENTS RELATING TO THE FAMILY 











Groups 
Seniors Parents Teachers 
CL Sk o Ue coe so od bedawee .99 + .004 
ss 9 is bone a eierke de ate .97 + .0l .98 + .01 ; 
REFS prereerE ere e .64 + .07 .65 + .07 .95 + .01 














coefficients are among the highest uncovered in the present study and 
indicate an astonishing unanimity of opinion between all groups save 
professors with seniors and with parents. The evolution of the family 
from an independent economic unit to the present functionaly decen- 
tralized institution is an observable phenomenon. Observable, also, 
are certain trends of social disintegration. The assumption, however, 
of a causal relationship between the two trends is not supported in the 
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present study. Present dea*+: :vould seem to indicate that there has 
not been a marked disintegration of family influences, nor has there 
been a striking change in family ideals, at least, within one generation. 

The opinion differences between the groups point toward « greater 
tolerance, a broader and more sympathetic understanding, and a higher 
idealism on the part of the professional social scientist. 


ATTITUDES TOWARD THE SCHOOL 


Educational planning commissions are attempting to formulate 
school policies with regard to questions of indoctrination, freedom of 
speech in the class room, the responsibility of the schools in pespetuat- 
ing the established order, the function of the school in a changing 
society, the responsibility of the school in preparing youths for! parent- 
hood, for citizenship, and for social living in a competitive world. 








Mean scores 
Opinion statement Stu- ‘ Teach-| P 
arents 
dents ers | fessors 





Teachers should teach only proved truths and 
should avoid discussing controversial issues in 
PN, < ba bcudepieeeris ses iceesces — .44 21 —.75 | —.86 

Courses of study have changed as rapidly as 
have the social and economic conditions out- 
I 6 ls din ne ene nen tie be enc .29 .28 — .60 | —.89 

The use of modern machines in industry has 
largely eliminated the need for highly trained 
SR i Wied ieee ak Sia ek eee ae he be a awh .12 .22 .-12 | —.39 

















These problems loom large on the school frontier today, and much is 
being written about them by prominent educators. Thus, for example, 
Kefauver' states: “The educational program in a democracy should be 
in harmony with the dominant democratic social values and aspira- 
tions,”’ and again, “‘the school has an unequivocal mandate to vitalize 
the democratic social ideal and to develop an educational program in 
harmony with it.” Broad generalizations such as these tend to be 
accepted without question, but when specific issues are raised which 
apply the generalization, unanimity of opinion is not so easily obtained. 
The opinions of students, parents, teachers, and social scientists toward 





1 Kefauver, Grayson N.: ‘An Educational Platform for 1936.” School and 
Society, Vol. XLIV, No. 1132, Sept. 5, 1936, pp. 289-295. 
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the functions and responsibilities of the school were sampled with 
thirty items of the opinionnaire. Included were such items as shown 
in the table on page 390. 

The total relationships between the mean opinions of the groups are 
shown in Table V. It is evident that there is considerable disparity 
TaBLE V.—COoEFFICIENTS OF CORRELATION BETWEEN THE MEAN ScoRES OF 


Seniors, Parents, TEACHERS, AND Prorgssors TOWARD TuirTy OPINION 
STaTEMENTS RELATING TO THE ScHOOL 











Groups 
Students Parents Teachers 
CG oss Jk abs eeuwaiekdilel 81 + .04 
, «ASR eege | 7 aeons 81 + .04 .87 + .03 
PL. ni c-c\d cath eod-daeabioknk 64 + .07 .55 + .09 .82 + .04 














between the opinions of parents and seniors on the one hand and the 
more informed social scientists on the other. Parents (and students) 
definitely favor the maintenance of the established order, with the 
implication that that which is, represents the true American Ideal. 
They favor rigorous restriction on freedom of speech and instruction, 
and are unwilling to have their children exposed to new social and 
political philosophies, favor biased and edited textbooks, and are of the 
opinion that high schools are developing in their students attitudes of 
critical open-mindedness toward social, political, and economic prob- 
lems. In general there seems a well-defined attitude on the part of 
parents that there shall be local determination of what social ideals and 
values shall be inculcated by the school. The ‘“‘dominant social values 
and aspirations” of the democracy are those which they themselves 
hold and approve. 


TOTAL RELATIONSHIPS 


Pooling all the items of the opinionnaire into one series, correlation 
coefficients were computed to indicate the total relationships between 
the groups. These coefficients are reported in Table VI. Teachers 
are seen to occupy a curious middle-ground between parents and pro- 
fessors. For the correlation coefficient of .88 there is an alienation 
coefficient of .48.1_ Reference to the items* toward which differences of 





1/1 —43 
2 Space limitations prohibit the publication of the entire list of items in the 
present article. 
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TaBLeE VI.—CoEFFICIENTS OF CORRELATION BETWEEN THE MEAN ScorzEs OF 
Sentors, ParENtTs, TEACHERS, AND PROFESSORS TOWARD THE TOTAL 














OPpINIONNAIRE 
Groups 
Seniors Parents Teachers 
ed ee webs eels .92 + .0l 
RT epee eu .85 + .02 .88 + .01 
ND ik ecb ae cendoaeeckes .66 + .04 .65 + .04 .88 + .01 











opinion occur, indicate that when teachers disagree with parents they 
tend to agree with professors, and when they agree with professors they 
tend to disagree with parents. The greatest alienation, .75, occurs 
between parents and university professors and the least, .39, between 
parents and seniors. 


THE RBLATIVE STRENGTH OF GROUP OPINIONS 


It is popularly believed that persons with little information basic to 
social and economic problems have strong prejudices regarding alterna- 
tive solutions, and that professional students of these questions, being 
informed on both sides, tend to have weak or uncertain attitudes 
toward such propositions as those used in the present study. Nelson! 
has shown that the standard deviation of a series of mean scores may 
bé used to indicate the relative strength of the opinions thus repre- 
sented. A large standard deviation would thus indicate a tendency for 
the group to show a relatively high agreement in the direction of either 
positive or negative reactions toward the several opinion statements. 
The standard deviations for the group scores on the total opinionnaire 
were found to be: 





SD students = .49 
SD parents = .53 
SD teachers = .63 


SD professors = .66 


It is noteworthy that, contrary to popular b: lief, university professors 
express most emphatic opinions and that, .oward the issues presented, 
they show the closest agreement among themselves. 





1 Nelson, Ernest: A Study of Conformity of Opinion in Certain Coilege Groups. 
Unpublished Master’s Thesis, Lange Library, University of California, 1933, 
under the direction of Prof. Noel Keys, cf. p. 39ff. 
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CAUSAL RELATIONSHIPS 


The assumption is widely made that adults exert a strong influence 
over high-school students. The development of desirable attitudes is 
stated as an objective of social-studies instruction in the schools, the 
presumption being that this goal is attainable. If a further assumption 
is made that this influence is in one direction only,' 7.e., from adults to 
the pupils, partial correlation coefficients derived from present data 
might be interpreted as indicating the dependence of pupil attitudes 
upon parent or teacher or professor attitudes when the influence of the 
others had been ruled out. Under this assumption the relationships 
thus revealed were found to be as follows: 


The dependence of seniors on parents, ris. = .61 
The dependence of seniors on teachers, ris.24 = .12 
The dependence of seniors on professors, rig23 = .01 © 
The multiple correlation coefficient, Rigas) = .92 


SUMMARY 


There is little evidence in the present study to indicate that social- 
studies instruction in our schools is succeeding in developing in our 
California high-school seniors attitudes and intelligent opinions toward 
issues basic to citizenship and social betterment beyond those which 
the seniors share with their parents as a group. 

The opinions of no one group reflect an interpretation of social 
issues which would be accepted by other groups as an expression of the 
dominant social values and aspirations of the democracy. In view of 
the strength of these conflicting opinions, it would seem that any 
application of a restricting “frame of reference” to specific issues would 
inevitably compel the schools to attempt an indoctrination of attitudes 
and values contrary to those held by the parents of our high-school 
children. 

The implication seems clear that if the schools are to promote and 
develop social attitudes in harmony with those held by persons best 
informed on social questions, cognizance must be taken of parental 
attitudes. There is strongly indicated a need for the development of 
codrdinated classes for parents with their children to study and to 
discuss public affairs under the guidance of the schools in order that 
there may eventuate intelligent opinions and unbiased attitudes 
toward significant social problems. 





1 The judgment of the author is that causal influences are probably reciprocal, 
but that the influence of adults over the boys and girls undoubtedly predominates. 
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SEX DIFFERENCES IN PERFORMANCE ON THE 
AMERICAN COUNCIL PSYCHOLOGICAL 
EXAMINATION 


T. M. LIVESAY 
University of Hawaii 


This paper is a continuation of a study reported in an earlier 
number of THe JOURNAL OF EDUCATIONAL PsycHoLoGy.! The same 
data are here analyzed to show sex differences—(1) as a whole, and (2) 


Tas_ze I.—Means, Siemas OF THE DISTRIBUTIONS, AND SIGMAS OF THE MEANS OF 


Ae 


nao 


THE Mazes (Five HunpDRED Five) AND Fema.es (THREE HUNDRED SEVENTY- 
TWO) FOR THE Five Sus-rest Scores aNpD Tora SCORES ON THE AMERICAN 
Councit PsycHOLoGiIcaAL EXAMINATION 























Test Measure Male Female 
ee gs eins ae wa died 27.15 26 .35 
Completion RN oe ie ee tie 12.435 11.605 
et ins Sead ak pede oe . 553 .602 
ea ad «cub Wie ckaneead 33.78 39.50 
Artificial language ip ialhianicn beaeenped ee 15.180 18.000 
ESSE err on reee mer nRT .676 . 933 
eee hss os cau ak ada 26 .60 24.50 
Analogies CE So eee caw hich hoe cba wes 14.420 13.915 
i hi cia eH 642 .722 
REGIE pera ELS ee 27.92 17.99 
Arithmetic | RSRRSBR ASE a pra es 12.935 11.935 
i Kuthn so ood ego cae .576 .619 
RE Shs bbe sath ba ceewees 33.56 35.05 
Opposites SR in Sia Sedna cde OM 16.150 16.630 
Ne Nn .719 . 862 
neue a 6s wtdb-o eon nae 148.72 143.89 
Total score RE Oh csc pteas cee ce koe 48 .345 50.700 
ST Cost oasdViet caswowl 2.151 2.629 














as between the sexes according to race—and the reliability of such 


differences. 





1Livesay, T. M.: ‘Racial Comparisons in Performance on the American 
Council Psychological Examination.” Journal of Educational Psychology, Novem- 


ber, 1936. 
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Table I gives the means, sigmas of the distributions, and sigmas 
of the means for the males as a whole (five hundred five) and females as 
a whole (three hundred seventy-two) for the sub-test scores and total 
scores—basic data for the computations of the chances of true differ- 
ences as given in Table II. It will be noted that the differences are in 
favor of the males (Table II) in four of the comparisons, and of the 
females in two; that for the Artificial Language and Arithmetic tests 
there is complete reliability of the differences; and that the difference 
in the case of the Analogies test shows almost complete reliability as the 
chances are ninety-nine in one hundred. As between high-school 
graduates it would seem that on the whole men do somewhat better on 
the American Council Psychological Examination than do women. 


Tasie I].—Sex Comparisons (TOTALS) IN TERMS OF THE CHANCES OF A TRUE 








DIFFERENCE 
Chances in 
Differ- - one hun- 
ence em dred that | Differ- 
Tests between | o(diff.) D the true | ence in 
means o(diff.) difference | favor of 
D is greater 
than zero! 
SIEIIIR, occ cccndusucies .80 .818 .98 84 Male 
Artificial language.......... 5.72 1.152 4.97 100 Female 
i a: conte nmantnd etn 2.10 .966 2.17 99 Male 
Apitihmotic.... 0.0... ccccccs 9.93 .845 | 11.75 100 Male 
NG bs ass vale be tase 1.49 1.122 1.33 91 Female 
. ..s cns na hone akee 4.83 3.396 1.42 92 Male 




















1 Garrett, Henry E.: Statistics in Psychology and Education. Table XIV, p. 134. 


In Table III the basic data are presented—means, sigmas of the 
distributions, and sigmas of the means of the males and females of the 
four racial groups for the sub-test and total scores—for the computa- 
tions in Table IV of the chances of true differences. 

An analysis of Table IV indicates differences in favor of: 

(1) Caucasian males over Caucasian females in four tests out of 
six, with complete reliability of the difference in favor of the females in 
the Artificial Language test and complete reliability of the difference in 
favor of the males in the Arithmetic test; 

(2) Caucasian males over Chinese females in all but Artificial 
Language, with complete reliability of the differences in four cases; 
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(3) Caucasian males over Japanese females in all but Artificial 
Language, with complete reliability in every case; 
(4) Caucasian males over Part-Hawaiian females in all tests with 
complete reliability in all but Artificial Language; 
(5) Caucasian females over Chinese males in all tests but Arith- 
metic, with complete reliability in three cases; 
(6) Chinese males over Chinese females in all but Opposites, with 
complete reliability only in the case of Arithmetic; 
(7) Chinese males over Japanese females in all but Artificial 
Language, with complete reliability in two cases; 
(8) Chinese males over Part-Hawaiian females in all tests with 
complete reliability in three cases; 
(9) Caucasian females over Japanese males in all but Arithmetic; 
with complete reliability in all cases except Analogies; 


Tasie III].—Nvumsers, Means, SigMas OF THE DISTRIBUTIONS, AND SIGMAS OF 
THE M®ANS OF THE MALES AND FEMALES OF THE Four Ractat GROUPS FOR 
THE Five Sus-test ScORES AND THE ToTaL SCORES ON THE AMERICAN 
Councit PsycHoLoGicaL EXAMINATION 





















































) Caucasian Chinese Japanese Part-Hawaiian 
: Test Measure 
: Male, |Female,| Male, |Female,|) Male, |Female,| Male, | Female, 
; 144 121 94 84 194 98 51 46 
} 
i 
EE. cnseda 34.12 | 31.25 | 25.25 | 25.22 | 22.74 | 21.90 | 27.30 | 24.95 
Completion| (dis.)....... 12.660] 12.425] 12.550) 10.510] 10.385) 9.975) 10.495) %.695 
| o(mean)...... 1.060} 1.129} 1.295) 1.147) .746) 1.008) 1.469 1, 420 
Sf ¢ 
- Artificial | Me®#B------++- 31.75 | 40.64 | 34.98 | 32.18 | 34.88 | 39.40 | 30.63 | 31,13 
y p =a o(dis.)....... 14.975| 14.965] 16.445] 18.165] 14.665] 18.365] 12.050] 14: 900 
y anguage | ¢(mean)...... 1.248] 1.360} 1.696] 1.982} 1.053] 1.855] 1.687] 2.197 
eee 4 —— 
1 Mk. 8G 29.81 | 29.27 | 27.25 | 21.94 | 24.86 | 23.89 | 22.79 | 19.28 
; Analogies o(dis.)....... 14.565] 15.310] 14.545) 14.235] 14.230) 13.390) 13.075) 11215 
' o(mean)...... 1.214) 1.392) 1.500) 1.553) 1.022) 1.353) 1.831) 1 654 
ee 28.60 | 20.30 | 31.30 | 18.09 | 27.85 | 16.85 | 20.53 | 15.04 
ie Arithmetic | o(dis.)....... 12.620] 15.525] 14.470) 13.545] 11.960) 10.845) 12.535) 8.755 
if o(mean)...... 1.052} 1.139] 1.493) 1.478} .859} 1.095} 1.755) 1.291 
4 SS eiggannehr 39.05 | 40.47 | 31.90 | 33.19 | 31.38 | 31.34 | 28.96 | 31.57 
ti Opposites o(dis.)....... 17.075| 17.640] 14.415] 15.990] 15.165] 14.455| 15.690] 16.010 
o(mean)...... 1.423} 1.604) 1.487) 1.745] 1.089] 1.460) 2.197) 2.361 
eee 162.31 |161.71 |151.40 |141.82 |141.85 |134.05 |131.41 |120.15 
Total score| o(dis.)....... 52.855| 53.685| 48.860) 55.575) 44.475) 41.110) 37.365] 46.620 
4 o(mean)...... 4.405} 4.880} 3.508} 6.064) 3.193] 4.153) 5.233) 6.874 
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TasLe [V.—Sex Comparisons OF THE Four Raciat Groups In TERMS OF THE 
CHANCES OF A TRUE DIFFERENCE 
























































Differ- 
Ra oy ya Diff i 
ce com- : ratio ifference in 
binations Tests tween o(diff.) D favor of 
means o(diff.) 
Completion............ 2.87 | 1.549 | 1.85 ucasian male 
Artificial language...... 8.89 | 1.846 | 4.82 ere female 
Caucasian male Analogies.............. .54 | 1.847 .29 Caucasian male 
Caucasian female | Arithmetic............ 8.30 | 1.550 | 5.35 Caucasian male 
ES ais oe cites nba 1.42 | 2.144 . 66 Caucasian female 
Total score............ .60 | 6.574 .09 Caucasian male 
Completion............ 8.90 | 1.562 | 5.69 Caucasian male 
; Artificial language...... .43 | 2.341 .18 Chinese female 
Caucasian male PEL, 5.5 os 00.5.0 howe 7.87 | 1.971 | 3.99 Caucasian male 
Chinese female Arithmetic............ 10.51 | 1.814 | 5.79 Caucasian male 
Cs  cheecen saa 5.86 | 2.252 | 2.60 Caucasian male 
Total score............ 20.49 | 7.495 | 2.73 Caucasian male 
Completion............ 12.22 | 1.463 | 8.35 Caucasian male 
; Artificial language...... 7.65 | 2.236 | 3.42 Japanese female 
Caucasian male Analogies.............. 5.92 | 1.818 | 3.26 Caucasian male 
Japanese female Arithmetic............ 11.75 | 1.518 | 7.74 Caucasian male 
SS Soe 7.71 | 2.029 | 3.78 Caucasian male 
Mn: cadens obs 28.26 | 6.054 | 4.67 Caucasian male 
Goes — leh Mik dn wig wat 1-7 ‘+. Saunton oo 
‘ rtifici nguage...... . ‘ ; aucasian e 
pomcetion malo = | Analegiat..........+-.- 10.53 | 2.052 | 5.13 Caucasian male 
‘oma soc cese sees 13.56 | 1.665 | 8.14 Caucasian male 
oc wieccseehs 7.48 | 2.757 | 2.71 Caucasian male 
Total G008O......cccecs 42.16 | 8.164 | 5.16 Caucasian male 
Completion............ 6.00 | 1.718 | 3.49 Caucasian female 
Artificial language...... 5.66 | 2.174 | 2.60 Caucasian female 
Chinese male Analogies.............. 2.02 | 2.046 | .99 Caucasian female 
Caucasian female | Arithmetic............ 11.00 | 1.878 | 5.86 Chinese male 
7. i6 am eascie 8.57 | 2.187 | 3.92 Caucasian female 
_ AR AEE 10.31 | 6.010 | 1.72 Caucasian female 
Sc dgeck aces .03 | 1.730 .02 Chinese male 
ery cial language...... 2.80 | 2.609 | 1.07 Chinese male 
Chinese male Analogies.............. 5.31 | 2.159 | 2.46 Chinese male 
Chinese female Arithmetic. ......-cc0% 13.21 | 2.101 | 6.29 Chinese male 
Dc arcécoheseen 1.29 | 2.293 . 56 Chinese female 
. 5 RISES X 9.58 | 7.006 | 1.37 Chinese male 
Completion............ 3.35 | 1.642 | 2.04 Chinese male 
Artificial language. ..... 4.42 | 2.513 | 1.76 Japanese female 
Chinese male Anslogies.............. 3.36 | 2.020 | 1.66 Chinese male 
Japanese female EG . oc anes ee es 14.45 | 1.852 | 7.80 Chinese male 
Sh.  ccreenhes ce .56 | 2.084 By Chinese male 
, fe 17.35 | 5.436 | 3.19 Chinese male 
— —— Reh Fe gl h He a .’ pd a mee eo 
. rtificial language...... . : ‘ inese male 
ange a Fo” i a 7.97 | 2.233 | 3.57 Chinese male 
aa Arithmetic............ 16.26 | 1.974 | 8.24 Chinese male 
nes CC 2.0n6 006 452% .33 | 2.790 .12 Chinese male 
Se 31.25 | 7.717 | 4.05 Chinese male 
Completion............ 8.51 | 1.353 | 6.29 Caucasian female 
Artificial language...... 5.76 | 1.720 | 3.35 Caucasian female 
Japanese male Es ch sis tees on0% 4.41 | 1.727 | 2.55 Caucasian female 
Caucasian female | Arithmetic............ 7.55 | 1.427 | 5.29 Japanese male 
kn 5. dom ds wae 9.09 | 1.939 | 4.69 Caucasian female 
» | eran 19.86 | 5.832 | 3.41 Caucasian female 





1 Garrett, Henry E.: Statistics in Psychology and Education, Table XIV, p. 134. 
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Taste IV.—Continued 
Chances| 
. one 
Diff "2 un- 
as| — leaties| de 
Race com- : ratio Difference in 
binations Tests tween | ?(diff.) D Oe bree favor of 
eugene o(diff.) | ence is 
greater 
than 
sero! 
Cones den nel tes ace hee : , = 3 i = : ; = oe avon oranate 
Japanese male sulin. Meer] g92 | 12850 | 1.87 6 | Sepaneep male 
Chinese female Arithmetic............ 9.76 | 1.709 | 5.71 | 100 | Japanese male 
EIRP Oa 1.81 | 2.057 .88 81 | Chinese female 
Total score............ .03 | 6.849 .004 50 | Japanese male 
Completion............ .84 | 1.254 .67 75 | Japanese male 
Artificial language...... 4.52 | 2.127 | 2.13 98 | Japanese female 
Japanese male Analogies.............. .97 | 1.697 | _.57 72 | Japanese male 
Japanese female Arithmetic............ 11.00 | 1.391 | 7.91 100 | Japanese male 
NG: 6 on nnine nes .04 | 1.821 .02 51 | Japanese male 
Total score............ 7.80 | 5.238 .49 93 | Japanese male 
Completion.........00. 1.21 | 1.612 .75 77 wert Mawelian 
emale 
Artificial language...... 3.75 | 2.436 | 1.54 93 | Japanese male 
Japanese male nalogies.............. 5.58 | 1.944 | 2.87 | 100 | Japanese male 
—— Arithmetic............ 12.81 | 1.551 | 8.26 | 100 | Japanese male 
female Opposites............. ‘19 | 2.600} .07 53 Part-Hawaiian 
emale 
Total score............ 21.70 | 7.579 | 2.87 100 | Japanese male 
Completion............ 3.95 | 1.853 | 2.13 98 | Caucasian female 
rtificial language...... 10.01 | 2.167 | 4.62 100 | Caucasian female 
Part-Hawaiian MLS. da cccveccecs 6.48 | 2.300 | 2.82 100 | Caucasian female 
e Arithmetic............ .23 | 2.092 -1l 5% | Part-Hawaiian 
Caucasian female e 
CONE, nic Se cecoces 11.51 | 2.720 | 4.23 100 | Caucasian female 
NN 6.5 6 .e:a-w-0s <0 30.30 | 7.155 | 4.23 100 | Caucasian female 
Completion............ 2.08 | 1.864 | 1.12 86 Eee MAGSNO® 
male 
\ Artificial language...... 1.55 | 2.603 .60 73 | Chinese female 
Part-Hawaiian DE cub ce vcbcetae .85 | 2.401 .35 64 | Part-Hawaiian 
mal e 
Chinese female Arithmetic. .....ccc00. 2.44 | 2.294 | 1.06 85 _ eee Saree 
male 
ere 4.23 | 2.806 | 1.51 93 | Chinese female 
BONED. basic etscess 10.41 | 8.010 | 1.30 90 | Chinese female 
Completion............ 5.40 | 1.782 | 3.03 100 vosp-wewetae 
male 
= Artificial language...... 8.77 | 2.507 | 3.50 100 | Japanese female 
Part-Hawaiian BMRA. ; oss sccss +s. 1.10 | 2.277 | 48 68 | Japanese female 
male Arithmetic............ 3.68 | 2.069 | 1.78 96 | Part-Hawaiian 
Japanese female : onaie 
COMEOR. « 6 «5:05.00 00 050 2.38 | 2.638 .90 82 | Japanese female 
Total score............ 2.64 | 6.681 .40 65 | Japanese female 
Completion............ 3.35 | 2.049 | 1.63 95 sin! acpi 
male 
Artificial language...... .50 | 2.770 .18 57 a! he -pgitmcomen 
emale 
Part-Hawaiian DI 5 din cceeeae 3.51 | 2.467 | 1.42 92 | Part-Hawaiian 
e 
Patawaiian SR cians dtawe 5.49 | 2.179 | 2.52 99 | Part-Hawaiian 
female d male i 
a 2.61 | 3.225 .81 79 | Part-Hawaiian 
female 
Total G008O....cccecces 11.26 | 8.639 | 1.30 90 | Part-Hawaiian 
e 























1 Garret, Henry E.: Statistics in Psychylogy and Education, Table XIV, p 134. 
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(10) Japanese males over Chinese females in four tests out of six, 
with complete reliability only in the case of Arithmetic; 

(11) Japanese males over Japanese females in all but Artificial 
Language, with complete reliability only in the case of Arithmetic; 

(12) Japanese males over Part-Hawaiian females in four out of six 
tests with complete reliability in three cases; 

(13) Caucasian females over Part-Hawaiian males in all but 
Arithmetic, with complete reliability in four cases; 

(14) Part-Hawaiian males over Chinese females in Completion, 
Analogies, and Arithmetic and Chinese females over Part-Hawaiian 
males in Artificial Language, Opposites and Total Score, with no case of 
complete reliability; 

(15) Japanese females over Part-Hawaiian males in four out of six 
tests, with complete reliability in two cases; 

(16) Part-Hawaiian males over Part-Hawaiian females in four out 
of six tests with no case of complete reliability. 

Table V gives the comparisons of the males of the four racial groups 
in terms of the chances of a true difference. The differences are in 
favor of the: 

(1) Caucasian over the Chinese in four out of six tests with complete 
reliability in two cases; 

(2) Caucasian over the Japanese in all but Artificial Language, with 
compicte reliability in all but two cases; 

(3) Caucasian over the Part-Hawaiian in all tests with complete 
reliability in all but Artificial Language; 

(4) Chinese over Japanese in all tests with no case of complete 
reliability; 

(5) Chinese over Part-Hawaiian in all but Completion with com- 
plete reliability in two cases only; 

(6) Japanese over Part-Hawaiian in all but Completion, with com- 
plete reliability in two cases only. 

In Table VI the females of the four racial groups are compared. 
The differences are in favor of the: 

(1) Caucasian over the Chinese in all tests with complete reliability 
in all but two cases; 

(2) Caucasian over the Japanese in all tests with complete reliabil- 
ity in all but two cases; 

(3) Caucasian over the Part-Hawaiian in all tests with complete 
reliability in every case; 











4 sbi 
a 
4 
rg 
“, 
i 


ee 


Ad | 


700 


TaBLeE V.—ComMPARISONS OF THE MALEs oF THE Four RaciaL Groups In TERMS 
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or THE CHANCES OF A TRUE DIFFERENCE 


























Chances 
in one 
hundred 
Differ- Critical that 
Race com- Teste ence ratio | thetrue| Difference in 
binations between | o(diff.) D differ- favor of 
means o(diff.) | ence is 
D greater 
than 
sero! 
Complletion......ccccsee 8.87 1.673 5.30 1.00 | Caucasian 
Artificial language....... 3.23 2.106 1.53 93 | Chinese 
Caucasian BI Sachs dscveveen 2.56 1.929 1.33 91 | Caucasian 
Chinese | Arithmetic............. 2.70 1.826 1.48 93 | Chinese 
SIS & \ a. 0's «0.0 aaeion 7.15 2.058 3.47 100 | Caucasian 
Total e0ore.......ccc0-. 10.91 5.631 1.94 97 Caucasian 
Comnpletion.......ccse00: 11.38 1.292 8.81 100 | Caucasian 
Artificial language....... 3.13 1.633 1.92 97 | Japanese 
Caucasian Analogies........ EXE Cea 4.95 1.587 3.11 100 | Caucasian 
Japanese cs. ot'n ga ode 4 .75 1.358 .55 71 Caucasian 
I ba'e se veceeses 7.67 1.792 4.28 100 | Caucasian 
RN cod i é:tene wats 20.46 5.440 3.76 100 | Caucasian 
ee 6.82 1.811 3.77 100 | Caucasian 
Artificial language....... 1.12 2.098 . 53 70 | Caucasian 
Caucasian RR sesaas cae secs 7.02 2.197 3.19 100 | Caucasian 
Part-Hawaiian | Arithmetic............. 8.07 2.046 3.94 100 Caucasian 
I Fb heedeseneva 10.09 2.618 3.85 100 | Caucasian 
ee 30.90 6.841 4.52 100 | Caucasian 
Completion........ ae 2.51 1.404 1.68 96 | Chinese 
Artificial language....... .10 1.996 .05 52 | Chinese 
Chinese BREE ccc ccccecss 2.39 1.815 1.32 90 | Chinese 
Japanese DE * on sine de Okan 3.45 1.722 2.01 98 | Chinese 
SS cuccnsevev .52 1.843 .28 61 | Chinese 
IID 66's ots cas eae 9.55 4.743 2.01 98 | Chinese 
Completion............. 2.05 1.959 1.05 85 | Part-Hawaiian 
Artificial language....... 4.35 2.392 1.82 96 Chinese 
Chinese pre 4.46 2.367 1.88 97 Chinese 
Part-Hawaiian | Arithmetic............. 10.77 2.304 4.67 100 | Chinese 
I cndwscabanube 2.94 2.653 1.11 86 | Chinese 
ee 19.99 | 6.300 | 3.17 100 | Cainese 
Completion............. 4.56 1.647 2.77 100 | Part-Hawaiian 
Artificial language....... 4.25 1.989 2.14 98 | Japanese 
Japanese Analogies............... 2.07 2.097 .99 84 | Japanese 
Part-Hawaiian | Arithmetic............. 7.32 | 1.953 | 3.75 100 | Japanese 
Opposites.............. 2.42 2.452 .99 84 | Japanese 
Total S00fO. ... 2222 cc0e- 10.44 6.131 1.70 96 | Japanese 























1 Garrett, Henry E.: Statistics in Psychology and Education. 


Table XIV, p. 134. 
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Taste VI.—CoMPARISONS OF THE FEMALES OF THE Four RactaL Groups IN 
TERMS OF THE CHANCES OF A TRUE DIFFERENCE 


























Chances 
in one- 
, Dif- Critical hundred : 
Race ee ’ ratio | that the Difference 
combinations Teste between | o(diff.) D true dif- in favor of 
means : ference 
D o(diff.) |i, greater 
than 
zero! 
Completion............. 6.03 1.610 | 3.75 100 | Caucasian 
Artificial language....... 8.46 2.404 3.52 100 | Caucasian 
Caucasian GR ovccedes ctvtecus 7.33 2.076 | 3.53 100 | Caucasian 
Chinese Arithmetic. .......c000. 2.21 1.866 1.18 88 | Caucasian 
dg. cadcaneabl 7.28 2.370 | 3.07 100 | Caucasian 
We ca cnccusones 19.89 7.784 2.56 99 | Caucasian 
Comnpletion....ccccssces 9.35 1.514 6.17 100 | Caucasian 
Artificial language....... 1.24 2.300 . 54 71 | Caucasian 
Caucasian Bs + kbs ddseecaces 5.38 1.941 2.77 100 | Caucasian 
Japanese Bs o'é.0 tc wawedess 3.45 1.580 2.18 98 | Caucasian 
PL ocecnacanoees 9.13 2.169 4.21 100 | Caucasian 
WD Gb hcaccctsses 27 .66 6.408 4.32 100 | Caucasian 
Completion. .......s.00- 7.30 1.821 4.01 100 | Caucasian 
Artificial language....... 9.51 2.583 3.68 100 | Caucasian 
Caucasian ROIS, veins ve essues 9.99 2.161 4.62 100 | Caucasian 
Part-Hawaiian | Arithmetic............. 5.26 1.722 3.05 100 | Caucasian 
Opposites.............. 8.90 | 2.854] 3.12 100 | Caucasian | 
ee 41.56 8.431 4.93 100 | Caucasian ' 
Completion............. 3.32 1.527 2.17 99 | Chinese 
Artificial language. ..... . 7.22 2.715 2.66 99 | Japanese 
Chinese Analogies............... 1.95 2.060 .95 83 | Japanese 
Japanese Arithmetic. ............ 1.24 1.839 .67 74 | Chinese 
| ee 1.85 2.275 .81 78 | Chinese 
II on. ucciesnanba 7.77 7.350 1.06 85 | Chinese 
 viccceeaae ae 1.27 1.832 .69 76 | Chinese 
Artificial language....... 1.05 2.959 .85 64 | Chinese 
Chinese PE cossccasctaccas 2.66 2.269 1.17 87 | Chinese 
Part-Hawaiian | Arithmetic............. 3.05 1.962 1.55 93 | Chinese 
PI 5 so aecn momane 1.62 2.936 . 55 71 Chinese 
Total score............. 21.67 9.166 2.36 99 | Chinese 
a 2.05 1.749 1.17 87 | Part-Hawaiian 
Artificial language....... 8.27 2.875 2.88 100 | Japanese 
Japanese CO ee 4.61 2.137 2.16 98 | Japanese 
Part-Hawaiian | Arithmetic............. 1.81 1.693 1.07 85 | Japanese 
GR ckcesscennese 0.23 2.776 .08 53 | Part-Hawaiian 
- 0  r e 13.90 8.031 1.73 96 | Japanese 























1 Garrett, Henry E.: Statistics in Psychology and Education. 


Table XIV, p. 134. 
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(4) Chinese over the Japanese in all but two tests with no case of 
complete reliability; 

(5) Chinese over the Part-Hawaiian in all tests with no case of 
complete reliability; 

(6) Japanese over Part-Hawaiian in four of the six tests with com- 
plete reliability only in the case of Artificial Language. 

In conclusion it should be pointed out, as in the previous article, 
that while these data indicate numerous sex differences of complete 
reliability, any significance which they may have as between races 
would apply only to these groups in the Territory of Hawaii and 
Continental United States. It is very doubtful if many of the racial 
groups in the United States (especially in the Territory of Hawaii) 
are to be considered as completely representative of their races as a 
whole because of the selective factors known to have been at work. 














RESPONSE TO VISUAL VS. VISUAL-AUDITORY 
PRESENTATION IN A GO-TO-COLLEGE PROGRAM 


FRANK R. ELLIOTT 
Indiana University . 


The child gets its sense impressions of the world into which it is 
born largely through the ear. At about eight years of age, when it 
learns to read, the child’s habits change, according to Kirkpatrick! 
and many other investigators, and the advantage swings away from 
auditory to visual mode. Further, it appears from various? studies 
that a combination of eye and ear stimulation becomes more effective 
upon attention and memory than does either mode alone. 

While the above conclusions have been put to test often in 
laboratory experiments, they have been demonstrated far less fre- 
quently in the emotional frame of the life situation. How is the 
individual affected by the eye or ear appeal, or a combination of the 
two, when he is in his normal, everyday surroundings and has before 
him a practical problem to be solved, such as buying, management, 
decisions concerning a future career? To which mode of presentation 
does he react most effectively? 

Some answer to the question seems to be indicated from a series of 
visual and visual-auditory types of presentation before ninety-two 
thousand six hundred eighty-one Indiana high-school seniors during 
the period, 1933-1935. Visual presentation was by printed literature; 
visual-auditory presentation was by literature combined with voice 
presentation. Contacts with the high-school seniors were under the 
author’s direction for the purpose of informing the seniors as to facilities 
offered by their State university, Indiana University, for a higher 
education. 

It is a common practice for universities and colleges, particularly 
the private institutions, to send literature and speakers to the high 
schools and other preparatory schools calling attention to courses, 
costs, and other facts of the respective institutions. Many high schools 
hold annual ‘‘Go-To-College” days and invite in college speakers. 
Tons of literature are mailed annually to the high-school seniors of the 





1 Kirkpatrick, E. A.: ‘Studies in Development and Learning.” Arch. Psychol., 
1909, No. 12. 
2 Elliott, Frank R.: “Memory for Visual, Auditory and Visual-Auditory 
Material.” Arch. Psychol., 1936, No. 199, pp. 8-13. 
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nation. Generally speaking, it is a respected practice for representa- 
tives of institutions of higher learning and of high schools as well to do 
what they can to stimulate young men and women of intellect 
and determination to go forward to a college career. Ex-President 
Hoover was attracted to college in that way. 

In the midst of the economic depression when jobs were scarce it 
was apparent that one of the most profitable uses the capable high- 
school graduate could make of his time was to try to improve himself 
through advanced study. Indiana University undertook to inform 
every Indiana high-school senior of its various courses, its costs, its 
opportunities for self-help, and other pertinent facts. A careful check 
of two types of response was made over the three-year period, 1933- 
1935: First, the inquiry response in the form of signed requests for 
departmental information, and, second, the enrollment response 
through registration at Indiana University the following September. 


MATERIALS AND PROCEDURE 


Visual materials included small, sixteen-page, descriptive, illus- 
trated bulletins. Visual-auditory materials included this same 
literature plus the facts of the literature presented through the spoken 
word of faculty representatives. About forty faculty representatives, — 
chosen in many cases because of their availability as much as because 
of their speaking ability, made the voice presentation. In view of the 
actual presence of the speaker, the visual-auditory mode in the present 
investigation represented a degree of social stimulation stronger than 
that which would be effected through such a visual-auditory medium 
as, television or sound films. 

It should be remembered that literature was furnished for students, 
whether or not a University representative was on hand. In each 
piece of literature was an inquiry card for the senior to use in requesting 
departmental information, and the number of these cards received 
was regarded as the measure of the inquiry response. Follow-up 
literature was mailed to those sending in the inquiry cards, whether 
those cards came from the visual or the visual-auditory group; follow-up 
procedure was the same for each group. 

The visual group consisted of fifteen thousand five hundred ten 
seniors. The visual-auditory group covered seventy-seven thousand 
one hundred seventy-one seniors. It was impossible to send speakers 
to all the senior classes, and the effort was made to schedule them for 
small and large schools alike in a fairly even geographical distribu- 
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tion among approximately eight hundred Indiana high schools. 
Difficulties of talking to a senior class of several hundred students were 
such that the extremely large schools were sometimes omitted from the 
visual-auditory group. The difficulties of travel to remote sections 
were such that the extremely small schools were omitted at times from 
the visual-auditory group. An effort was made to rotate visits among 
the different schools of a county so that each school would be reached 
with visual-auditory presentation (literature and speaker) at least once 
in the three-year period, though this was not always possible in each 
county. 

As in all field experimentation, it was impossible to control all 
conditions except the independent variable of mode of presentation. 
The numbers were so large, however, that it seems fairly reasonable 
to assume that such variables as influence of alumni were distributed 
equally throughout the visual and the visual-auditory groups to bring 
about what the author has termed an Equilibrium of Variables. If this 
assumption is valid, the independent variable of mode of presentation 
can be measured in its effects upon the ninety-two thousand six hun- 
dred eighty-one subjects. 


RESULTS 


The following tables show for each type of presentation the num- 
bers reached, the numbers responding, the percentage responding, and 
the ratio of advantage held by one mode of presentation over the other. 
Results for each of the three years are shown, as well as results for the 
three years combined. Results for both the inquiry and the enroll- 
ment responses are indicated. 

Table I shows that the percentage of inquiries following visual- 
auditory presentation is seven times as high for the three-year period 
as the percentage of inquiries following simple visual presentation. 
The advantage for visual-auditory presentation is marked for each of 
the three years. 

Table II shows that the percentage of enrollments following visual- 
auditory presentation is twice as high as the percentage following 
simple visual presentation. The visual-auditory advantage is con- 
sistently pronounced for each of the three separate years. 

These results bear out the author’s! laboratory experiments and 
those of many other investigators showing the relative superiority of 





1 Op. cit. 
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TasLe I.—Tue Inquiry REsPonsE 
Type of Numbers | Numbers | Percentage Br eos 
presentation reached | responding} responding neil ies 
Year 1933: 
isi bl 6 u'dish's late ibibcg 8 ,430 353 4.18 | Visual-auditory 
Visual-auditory.......... 21 ,847 5,031 23 .03 5.3 to 1 
Year 1934: 
Sans Sx owns wba 0. ore 4,149 316 7.61 | Visual-auditory 
Visual-auditory.......... 27 ,102 9,989 36 . 86 4.8 tol 
Year 1935: 
A Re a 2,931 14 .48 | Visual-auditory 
Visual-auditory.......... 28 ,222 9,113 32.28 67.2 to 1 
Three Years 1933-1935: 
_ ARGOS R TRS a, 15,510 683 4.44 | Visual-auditory 
Visual-auditory......... -| 77,171 24 ,133 31.27 7.0 to 1 
TaBLE II.—TxHe ENROLLMENT RESPONSE 
Type of Numbers | Number | Percentage eee 
presentation reached | responding! responding anhinatia 
Year 1933: 
ME Ciidywewds woes Se 8 ,430 144 1.70 Visual-auditory 
, Visual-auditory.......... 21 ,847 941 4.30 2.5 tol 
Year 1934: 
lice aca a a gan 4,149 97 2.34 Visual-auditory 
Visual-auditory.......... 27 , 102 1 ,076 3.97 1.7 tol 
Year 1935: 
EE CAG hess'b weed oh 2,931 89 3.04 
Visual-auditory.......... 28 , 222 1,358 4.84 1.6 to 1 
Three years 1933-1935: 
de ae Le gy | 15,510 330 2.19 
Visual-auditory.......... 77,171 3,375 4.37 2.0 to l 

















combined visual and auditory stimulation as compared with simple 


visual mode. 


The sound of the human voice appears to have a social 


significance and appeal which is out of all proportion to its mere sensory 
stimulus value, and in our present study the presence of the speaker in 
person doubtless added force to the visual-auditory presentation. 

The consistency of the results over three successive years, with 
nothing approaching a reversal of evidence favoring the visual-auditory 
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mode, seems to indicate the reliability of our findings. The enormous 
size of our test group, namely, ninety-two thousand six hundred eighty- 
one subjects, and the random distribution of the two modes of presenta- 
tion among seniors of city and country schools, of poor and rich 
communities, of schools near to and distant from the University—all of 
this would ten? to establish an equilibrium of variables and thus to 
rule out factors of influence other than that of mode of presentation. 

Some evidence of the validity of our findings in the present field 
study is to be found in the fact that the field representative plan of 
building college enrollment has long been used successfully by the 
universities and colleges. Secondary-school officials have recognized 
the value of visual-auditory presentation through college field repre- 
sentatives, even to the extent of setting up “‘Go-To-College”’ programs 
and inviting speakers from universities and colleges to come to the 
high schools and present the facts of their respective institutions. 

While common sense and experience have dictated the use of the 
visual-auditory mode or field representative plan of building college 
enrollment, the present study, so far as the author knows, offers the 
first objective evidence of the overwhelming advantage of the visual- 
auditory mode over the simple visual mode. In fact, with a small 
control group of three hundred seventy-one seniors the first year of the 
experiment, the author found sending literature alone very little better 
from the standpoint of gaining enrollment than doing nothing at all. 
The control group, which was not stimulated by the University in any 
way, contributed 1.62 per cent of its members to the University’s 
enrollment, while the visual group contributed 1.7 percent. This may 
be interpreted to mean that sending out vast quantities of printed 
matter, without any accompanying personal contact, is a great waste. 

The recent national conference on education by radio emphasized 
the importance of the radio voice not so much from the standpoint of 
its value in formal instruction as from its importance as a stimulus to 
educational thought. So in the present experiment, the personalized, 
visual-auditory mode of presentation brought from two to seven times 
the response given to simple visual mode. 
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BOOK REVIEWS 


Booxs ON PERSONALITY 


WInIFRED V. Ricumonp. Personality, Its Development and Hygiene. 
New York: Farrar & Rinehart, 1937. 

Ross Stacner. Psychology of Personality. New York: McGraw-Hill 
Book Co., 1937. 

James §. Puant. Personality and the Cultural Pattern. New York: 
The Commonwealth Fund, 1937. 


The first of these recent books on personality is a presentation of 
modern approaches to the study of human nature by the psychologist of 
St. Elizabeth’s Hospital. The personality is here presented in its 
deveiopment and hygiene. The book is based upon some of the 
material accumulated by the author in teaching various aspects of the 
subject throughout fifteen years to social workers, naval medical 
officers, nurses, medical students, teachers, parents, and in her practice 
with patients in a psychiatric hospital. The treatment is consequently 
colored by the psychiatric point of view. Dr. Richmond recognizes 
that scientific data on the human personality are as yet too scanty to 
make a comprehensive work on the subject possible. Nevertheless, 
whatever we do know about the human personality has come mainly 
from psychological investigation, so that a treatment of the subject 
mustdraw upon psychology. By personality Dr. Richmond means the 
physical and mental make-up that distinguish one person from another, 
and the body of her book is devoted to a discussion of the fundamental 
psychophysical traits: The body, intelligence, emotion, energy and 
orientation. The book also treats of the methods of studying the 
personality and the maladjustments and disorders of the personality. 

Dr. Stagner’s book is written from the standpoint of the psychologist 
interested primarily, if not exclusively, in the study of the normal, 
everyday personality, and is intended to meet the needs of those per- 
sons who complain that reading lists on the subject place too much 
stress on the pathological. The book deals in the main with personality 
traits and seeks to present a systematic set of concepts which will fill 
out the framework of trait psychology, measurement, procedures, etc. 
Personality is treated as a set of concrete, identifiable responses of a 
behaving organism, and hence stress is placed upon visceral processes 
and gestural activities. Another feature of the book is the contention 
of the author that plural statements have no real place in the psychology 
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of personality. The object of his study is a simple human being who 
reacts to and reflects the presence and characteristics of other human 
beings. A radical departure from the customary material found in 
books on this subject is a final chapter devoted to the problems of social 
reform. Psychology the author holds to be the basis of the social 
sciences, and hence it has something to contribute to a correct solution 
of social problems. It is in this spirit that he presents the deductions 
from personality to social values in that chapter. 

The third of these books is by the Director of the Essex County 
Juvenile Clinic and is written with the conviction that “the usual 
psychiatric formulations for the problems of children are inadequate, 
and that in some way the forces of the cultural pattern in which we 
live are of dynamic importance to the personality.’ The author is, 
therefore, concerned throughout his book with a study of the impact of 
the environment upon inner motivations. The first three chapters are 
devoted to pointing out ‘‘ what can be learned from an individual at the 
moment of his first and perhaps temporary break with his environment 

..” This is followed by a description of an effective set-up for 
tapping this source of information. The next four chapters give 
examples of the type of material that was gathered by this method. 
Nine chapters are then given over to tracing the implications of the 
author’s hypothesis for the family, school, recreation, law and order, 
social work, medicine, church and industry. The final chapter brings 
the whole into focus in terms of education for life. 

Max ScHOEN. 

Carnegie Institute of Technology. 


Horatio H. Newman, FRANK N. FREEMAN and Karu J. HOLZINGER. 
Twins; a Study of Heredity and Environment. Chicago: Chicago 
University Press, 1937, pp. XVI + 369. 


This long-awaited study scarcely lives up to our expectations. It is 
divided into two parts, the first a comparison of one hundred pairs of 
mono-zygotic and di-zygotic twins reared together; the second a com- 
parison of twenty sets of mono-zygotic twins reared apart, nineteen of 
whom were tested by the authors. It is the second study that is the 
more interesting, since it is with identical twins reared apart that we 
should get a clear-cut issue as to amount of change that differing 
environments can effect. Take the case of the first pair, Alice and 
Olive, for instance. These were born in London, England. On the 
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death of the mother when the twins were eighteen months old, Olive 
was brought to Canada and Alice remained in London. The twins 
did not meet for seventeen years, but at the time of testing had lived 
together for a year in Canada. Since they were mono-zygotic they 
had identical heredities. What is the environmental effect of schooling 
in London compared with that of Oshawa? One has only to select 
suitable tests to determine the differences. 

The experiment was carefully controlled. One had to be sure that 
the twins were mcno-zygotic and the tests made to ensure that such 
was the case (p. 35) are beyond cavill. Secondly, the tests and 
measurements should be fair to both. That they were eminently fair 
to both can be seen from the tests and ratings used (see pages 29-31). 
Thirdly, the statistical comparisons of results should be above suspicion, 
and again the study meets the test. 

It is when we come to the interpretation of the results that there is 
room for differences of opinion. Even the three authors are not alto- 
gether in agreement. Newman, for instance, is inclined to attribute a 
larger share of the differences to pre-natal factors than is Freeman. 
One of the authors is inclined to treat the unseparated identical twins 
as a control group and to regard only the excess differences of the sepa- 
rated twins as attributable to their post-natal ex vironment. 

When all nineteen cases are included, the separate and joint influ- 
ences of educational and social differences account for seventy-two per 
cent of the variance in IQ difference; if four extreme cases are omitted, 
they only account for twenty per cent of the IQ variance. ‘The 
analysis indicates that the réle of heredity and environment in produc- 
ing twin differences is a function of the type of environment. Thus for 
twins reared together, most of the difference between members of a pair 
may be due to the nature factor; whereas for twins reared under strik- 
ingly different environments, the nurture factors will have a relatively 
greater influence. It is apparent from several of the comparisons made 
that the relative effect of hereditary and environmental differences is 
also a function of the type of trait. Any fixed ratio of these two factors 
for all traits and conditions is thus impossible. From the viewpoint of 
the educator it is important to note that extreme differences is educa- 
tional and social environments are accompanied by significant changes 
in intelligence and educational achievement as measured by our tests” 
(p. 349). Thisisfrightfully disappointing. Has the mountain labored 
for ten years to produce such a mouse? However, to discover that the 
problem is incapable of a general solution, since there is not one prob- 
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lem but a multiplicity of minor problems, is perhaps worth while. In 
this reviewer’s opinion, however, we should not rest at this stage. 
Somebody with greater skill and acumen may be able to take the data 
and work it out to more clear-cut conclusions. We cannot remain 
satisfied with Jennings’ dictum that what heredity can do, environment 
can also do. It runs contrary to common sense and to common obser- 
vation, and anything that runs contrary to these is always under 
suspicion. Is the work of Morgan and his school as insecure in its 
foundations as this work would make it out to be? 
Peter SANDIFORD. 
University of Toronto. 


GERTRUDE Hitpretu. Learning the Three R’s. Minneapolis: Educa- 
tional Publishers, 1936, pp. [IX + 824. 


This text, designed for the educational psychologist and the student 
of educational methods in the elementary school, is confined to a dis- 
cussion of reading, writing, spelling and arithmetic. In successive 
sections of the book are considered, respectively: (1) Description of the 
newer program in the four skills; (2) the problem of school failures; (3) 
diagnosis in the four skills; and (4) suggestions for improving techniques 
of instruction. 

The author is to be especially commended for two major points of 
emphasis: (1) The genetic approach, which is based upon the view that 
“learning is most successful when the task is adapted to the capacities 
of the child or suited to his maturation level.’’ The recent increased 
interest shown in readiness for reading illustrates the progress of this 
point of view among teachers and school administrators. (2) Flexi- 
bility of instructional techniques is favored rather than any single 
method, such as textbook teaching and the like. Thus a more casual, 
informal, and natural introduction to learning results. 

The section on diagnostic and remedial methods is by far the best 
part of the book. The evaluation of techniques is critical and the 
suggestions on programs, materials, sources of information and inter- 
pretation are adequate. 

Many readers of this book, especially the students, will be dissatis- 
fied with the organization of the first two-thirds of the material. The 
author often adopts an approximation of the outline method. She 
frequently presents in itemized order practically all that has been said 
or found out about a subject. An example is the listing of thirty-three 
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suggestions for wholesome personality adjustment in the school child. 
Most readers would get more from a discourse based upon evaluation 
and correlated discussion of the items. The subject-matter in the 
field, however, is very completely covered. 

The typography of the book is excellent with one exception; the 
highly glazed paper produces an uncomfortable glare in most artificial 
light. 

For perhaps the first time one finds in a textbook a satisfactory 
evaluation of the réle of eye movements in reading. ‘Eye movements 
are resultants of perceptual habits which are in turn dependent on 
comprehension patterns.” There is, however, an unfortunate depar- 
ture from this point of view when it is stated that reversals of letter 
sequence in perceiving certain words are due to faulty eye movements, 
and suggestions for training the ‘“‘eye sweep”’ to remedy the situation 
are given. 

This book will be rated high by most educators and will undoubtedly 
find much use. It is difficult to imagine a more complete covering of 
this particular subject-matter. Mixes A. TINKER. 

University of Minnesota. 
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The Psychology of the 


Common Branches 
By Wituiam H. Prix 


“Doctor Pyle has produced a very 
useful, teachable, and productive con- 
tribution to the psychology of teaching. 
In this book the principles essential to 
the effective teaching of reading, spell- 
ing, handwriting, and arithmetic are 
set forth ... The book is not only 
one that can be used as a textbook 
but it is an exceptionally good refer- 
ence work.”—Journal of Educational 
Research. 

“The book is written in clear, non- 
technical style and should be very 
valuable for the student in training or 
for the teacher who wishes to make a 
quick survey of the scientific principles 
involved in teaching the four skill 
subjects.”—Bulletin, New York Society 
for Experimental Study of Education. 
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When You Say Webster's Dictionary 
You MEAN the MERRIAM-Webster 


Accept Nothing Less Than 
the SUPREME Authority 





‘THROUGH four generations Webster’s Dic- 
tionary has earned and maintained first 
place among reference books. When you are 
confronted with any question of fact, whenever 
you need to know, you think of Webster as the 
utmost in authority, the judge of judges, the 
court of last appeal. But that confidence is 
warranted only if you use the Merriam- 
Webster. 

Look for the Merriam-Webster trade-mark 
when you buy a dictionary. The New Second 
Edition of Webster’s New International (un- 
abridged) is 20 years newer, contains 122,000 
more entries than any similar dictionary. Pro- 
vides information in all branches of knowl- 
edge. The authority in courts, colleges, news- 
papers. Prepared by 207 experts. 600,000 en- 
tries; 3,350 pages. 12,000 terms illustrated. Ask 
your bookdealer, or write for free booklet. 


G. & C. Merriam Co., Dept. 11, Springfield, Mass. 





A DETERMINATION 


OF GENERALIZATIONS BASIC TO THE 
SOCIAL STUDIES CURRICULUM 


By Neat Brtiines 


RESENT conventional courses in history, geography, and civics fail to achieve 
Pa adequately as possible the great aims of the social studies. Granting that 
existing courses acquaint pupils with many of the main facts of life, still not all of the 
important facts are presented nor are the vital inter-relationships indicated. 

In this study Professor Billings points the way toward a more effective curric- 
ulum by setting forth the basic generalizations needed by those who are making 
curricula in the social studies in order that prospective American citizens may be 
taught to think intelligently about the conditions and problems of contemporary life. 
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sible to the teacher.” Peter Sandi- in teaching the four skill subjects.” 
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“The form of presentation is clear 
and pointed, so that the book 
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American Journal of Psychology. 
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